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target  in  a  field  of  decoys  has  been  developed.  The  model  was  used  to  assess  the  4 
potentials  of  tactical  deception  techniques  in  antisubmarine  warfare.  This  research" 
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ABSTRACT 


A  semi-Markov  model  representation  of  a  submarine  searching  for  a 
high  value  target  in  a  field  of  decoys  has  been  developed.  The  model 
was  used  to  assess  the  potentials  of  tactical  deception  techniques  in 
antisubmarine  warfare.  This  research  memorandum  describes  the  details 
of  the  model  structure.  The  assessment  results  are  published  in  a 
separate,  classified,  final  project  report.  In  its  present  form,  the 
model  represents  the  first-generation  of  a  promising  approach  that  can 
address  a  large  class  of  tactical  deception  assessment  problems. 
Possible  extensions  and  uses  of  the  present  model  together  with  some 
areas  potentially  requiring  new  formulation  of  the  semi-Markov  approach 
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PREFACE 


The  work  reported  in  this  research  memorandum  was  conducted  os  a 
subtask  within  a  larger  project  directed  toward  the  assessment  of 
tactical  deception  techniques  in  antisubmarine  warfare.  The  project 
was  sponsored  by  the  Naval  Analysis  Programs  Group,  Mr.  R.  J.  Miller, 
Director,  in  the  Office  of  Naval  Research.  Mr.  J.  G.  Smith  was  the 
ONR  Project  Scientific  Officer. 

The  research  effort  was  performed  by  the  Naval  Warfare  Research 
Center,  Mr.  L.  J.  Low,  Director,  of  Stanford  Research  Institute. 

Mr.  A.  Bien  of  NWRC  was  the  project  leader. 

The  author  wishes  to  acknowledge  other  members  of  NWRC,  in 
particular  Mr.  G.  W«  Black  and  Mr.  M.  W.  Zumwalt,  for  their  help  in 
discussions  which  led  io  formulation  of  the  problem,  resolution  of  some 
perplexing  difficulties,  and  correction  of  some  technical  errors. 

Mrs i  Terry  Silvia  did  an  excellent  job  in  typing  a  difficult  manuscript. 


SUMMARY 


Model  Framework 

The  semi-Markov  process  is  an  effective  framework  within  which  to 
study  questions  regarding  the  capability  of  decoys  to  delay  a  searcher 
looking  for  a  particular  type  of  target. 

The  problem  of  search  in  the  presence  of  decoys  naturally  lends 
itself  to  representation  by  a  semi -Markov  process  because  the  state  of 
the  searcher  arid  the  transitions  between  states  are  well  defined. 
Although  the  necessary  assumptions  for  a  continuous  time  Markov  chain 
can  be  intuitively  justified  in  some  cases,  placing  the  problem  in>  the 
format  of  a  more  general  semi -Markov  process,  provides  a  framework  which 
can  accept  experimental  data  that  might  not  be  Well  adapted,  to  the  more 

,  '  ,  l 

'’.zed  Markov  chain.  ’ 

i 

A  primary  feature  of  the  wprk  reported  ori.^her«?in  is  that,  the 
solutions  to  the  various  models  considered  are  in  an ^easily  calculable 
closed  form.  •  t 

The  specific  situation  represented  is  as  follows.  A  number  of 

high  valrie  targets  (HVTsXaro  operating,  within  s  certsi.i  specified 

area.  Operating  within  the  same  area  are  a  number  of  low  value  target? 

» 

called  decoys.  A  searcher  enters  the  area  at  time  zero  dnd  begins 
looking  for  the  high  value  targets.  (We  assume  the  searcher  wishes  to 
destroy  the  HVTs,  but  this  assumption  is  not  crucial  to  model  develop-?: 
merit.)  In  the  search  process  the  searcher  encounters  the  decoys,  .which 
have  characteristics  similar  to  the  HVTs.  Because  destruction  of  a 

r 
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target  involves  expenditure  of  a  limited  resource,  as  well  as  possible 
compromise  of  searcher  concealment,  the  searcher  does  not  Msh  to  de¬ 
stroy  decoys;  he  must  therefore  bpend  time  to  classify  a  target  as  high 
value  or  decoy.  The  searcher  wants  to  minimize  search  time;  the  targets 
wish  to  maximize  it.  The  targets  are  cot  able  to  observe  the  searcher, 
and  the  searcher  must  devote  his  attention  to  a  single  target  if  he 
encounters  several  at  one  time  or  over  a  short  interval  of  time. 

Model  Application 

»  * 

A  three-state  semi -Markov  mode).  was  implemented  that  incorporates 
the  events:  (1)  start  search;  (2)  start  classifying  a  decoy,  and 
(3)  start  classifying  an  HVT.  Event  (3)  is  defined  as  the  absorbing 

state.  The  following  assumptions  governed  the  structure  of  the  model: 

*  *"  '  • 

•  At  any.  fixed  instant  in  time,  positions  of  HVTs  and 
decoys  are  distributed  over  the  operating  area 
apcording.  to  a  uniform  probability  distribution 

•  Over,  short  intervals-  of  time;  everything  moyea  in 
straight  lines  with  uniformly  random  headings 

•  Detection^is  represented' by;  . a  ilefihite  range- law  1  , 

•  All-  detection,  circles  lie -inside  the;  operating  area 

- 5 ,  . p . .  p* r' 

(i;.e  <-,  the:  s.earcher  .-as- welt  as  the^KVT -Knows- what. 

the-  operating- area':  is) 

*  »  ’ 

•  When  a  decoy  is  classified,  information  obtained  by 
the  searcher  is  dissipated  rapidly  enough  so  that 
the  classification  has.no  operational  effect  on  the 
density  of  decoys 

•  When  presented  with  ah  array  of  targets  (both 

decoys  and>  HWs)-  f  rom  .\diich;;6ne  is  to  be  selected 
for  classification;  the  targets  are  equally  likely 
to  be  chosen  (i.e-. ;  the  decoys  are  identical  and’ 
are  indistinguishable  from  the  identical  HVTs  until 
a  classification  is  made)  > 


0  Stochastic  independence  of  motion  is  assumed  among 
decoys  as  a  group,  among  HVTs  as  a  group,  and  between 
the  two  groups  except  in  the  case  of  reduced  overlap 
when  HVTs  avoid  de<  oys . 

In  addition,  it  was  assumed  that  search  and  classification  times  are 
exponentially  distributed  (reducing  the  semi -Markov  model  to  a  Markov 
model).  Simulation  studies,  conducted  as  an  adjunct  to  the  semi-Markov 
model  formulation,  demonstrated  that  the  assumed  exponential  search 
time  distribution  and  the  adopted  model  for  determining  mean  time  to 
target  detection  are  in  fact  valid  with  respect  to  the  assumptions  made 
concerning  the  search  process  (primarily  the  definite  range  detection 
law).  The  validity  of  assuming  expo:.ential  distribution  for  classifi¬ 
cation  time  remains  to  be  demonstrated.  Mean  time  to  classification  is 
handled  ns  an  input  variable  in  the  current  stu§y.  The  three-state 
model  was  used  to  address  the  following  questions: 

1.  How  long  does  it  take  the  searcher  to  find  a  high 
value  target  (i.e.,  what  is  the  mean  time)? 

2.  How  many  decoys  are  encountered  before  an  H7T  is 
found  (i.e.,  mean  number)? 

3.  What  are  the  relative  effects  of  decoy  characteristics 
such  as  number,  speed,  detectability,  and  realism 
(classification  time)  on  the  quantities  above? 

4.  How  many  decoys  with  the  given  characteristics  are 
required  to  provide  a  certain  level  of  safety  for 
the  high  value  targets  (e.g..  provide  a  vcrt&in 
minimum  level  of  probability  of  an  HVT  being  detected 
over  a  specified  time  interval)? 

Answers  to  the  above  questions  for  a  realistic  operational  situation 
are  presented  in  a  separate,  classified,  final  project  report.* 


*A.  Bien;  "Evaluation  of  Tactical  Deception  Techniques  in  Carrier  Task 
Force  Defense"  (U),  Final  Report;  SRI  Project  1016-245,*.  Contract 
N00014-71-C-0119 ;  Stanford  Research  Institute,  Menlo  Park,  California, 
December  1971  (SECRET) 
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Model  Extension 


The  following  are  specific  recommendations  directed  toward  the 
potential  extension  of  the  semi-taa^ov  model  approach: 

1.  Derive  output  expressions  for  a  searcher  starting  in 
the  classify  decoy  state. 

2.  Given  the  assumption  of  a  constant  range  detection  law, 
the  three-state  model  is  a  suitable  representation  of 
the  search  problem,  within  the  limits  of  the  random 
motion/position  assumption,  the  restrictions  due  to 
overlap,  and  a  large  (relative  to  detection  radii) 
operating  area.  In  order  to  extend  these  limits  it  is 
recommended  that  the  effect's  of  geometry  and  time  on 
the  state  transition  mechanism  in  the  three-state 
model  be  studied  in  detail  end  the  ttyree-atate  model 

O' -i>anHofl  +n  fony  ofofou  Ijy 

search  state*. 

3.  A  ubiquitous  assumption  in  this  study  is  the  definite 
range  detection  law.  The  realized  detection,  runga  in 
any  real  encounter  is  a  random  variable  thfct  is  rep¬ 
resented  in  the  models  discussed  hero  hy  a  f  ired  range 
R  (which  depends  on  the  type  of  target  and  its  speed 

as  well  as,  searcher  and  environmental,  characteristics) . 

If  the  target  comes  within  R  of  the  searcher;  the  target 
is  assumed  detected;  no  detections  occur  at  ranges  greater 
than  R,  The  value  assigned  to  R  is.  usually  the  median 
value,  of  a  distribution  generated  by  mode?  jpuisitie  the 
scope  of  this  study.  The  search  models  t  eseuted  in  this 
document  permit  sensitivity  studies  on  R  out  they  do,  not 
take  into  account  the  inherent  variability  in  realized 
detection,  ranges.  Hence,  it  is  recommended  that  a  study 
be  conducted  to  determine  the  effect  of  this  inherent 
variability  on  the  results  produced  by  the  current  search 
models.  Such  a  study  could  be  conducted  with  Markov , 
process  models  and  could  examine  faide  zone  effects  as 
well  as  variable  detection  range. 

4.  An  area  for  analytic  extension  is  the  situation  of 
stationary  decoys  where  the  searcher  can  plot  the 
position  of  classified  docoj;-  and  thus  render  them 
relatively  ineffective.  The  th^ee -state  model  is 
not  applicable  in  this  situation  because  the  tran¬ 
sition  probabilities  charge  with  each  decoy  that  is 
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classified.  What  is  needed  is  a  general  n-state 
formulation. 


Several  interesting  questions  involving  constrained 
optimization  arise.  Loosely  speaking,  it  is  clear 
that  the  more  decoys  that  are  available  the  better 
for  the  HVT.  However,  it  is  also  clear  that  the 
choice  of  decoy  configuration  and  number  of  decoys 
is  a  constrained  problem.  This  constrained  choice 
problem 'will  assume  characteristics  dependent  on  the 
circumstance  within  which  it  arises.  Some  possibilities 
are: 

•  Given  specified  limited  funds,  how  many  decoys 
of  what  configuration  should  be  built  to 
optimize  some  operational  variable,  such  as 
probability  of  HVT  detection? 

•  In  initial  planning  stages,  how  do  the  optimum 
number  and  configuration  in  tho  preceding 
question  vary  as  the  amount  of  available  funds 
varies? . 

•  Funds  are  "limited"  but  not  specified.  Therefore, 
it  is  desired  to  meet  some  operational  performance 
threshold  (such  as  a  minimum  acceptable  HVT  de¬ 
tection  probability)  lirith  minimum  cost.  How  many 
decoys  of  what  configuration  should  be  built  and 
what  is  the  cost? 
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1 .  INTRODUCTION 


This  report  discusses  semj -Markov  models  of  a  random  search  process 
with  decoys.  The  primary  situation  envisaged  is  as  follows.  A  number 
of  high  value  targets  (HVTs)  are  operating  within  a  certain  specified 
area.  Operating  within  the  same  area  are  a  number  of  low  value  targets 
called  decoys.  A  searcher  enters  the  area  at  time  zero  and  begins 
looking  for  the  high  value  targets.  We  assume  the  searcher  wishes  to 
destroy  the  HVTs,  but  this  assumption  is  not  crucial  to  model  develop¬ 
ment.  In  the  search  process  the  searcher  encounters  the  decoys.  The 
decoys  have  characteristics  similar  to  the  HVTs.  Because  destruction  of 
a  target  involves  expenditure  of  a  limited  resource,  as  well  as  possible 
compromise  of  searcher  concealment,  the  searcher  does  not  wish  to  destroy 
decoys;  therefore  he  must  spend  time  to  classify  a  target  as  high  value 
or  decoy.  The  searcher  wants  to  minimize  search  time  while  the  targets 
wish  to  maximize  it.  The  targets  are  not  able  to  observe  the  searcher, 
and  the  searcher  must  devote  his  attention  to  a  single  target  if  he 
encounters  several  at  one  time  or  over  a  short  interval  of  time.  Targets 
and  searcher  are  assumed  to  be  moving  randomly  in  the  following  sense 

i)  At  any  fixed  instant  of  time  positions  are  uniformly 
random  over  the  operating  area 

ii)  Over  snort  intervals  of  time  everything  moves  in 
straight  lines  with  uniformly  random  headings. 

These  two  assumptions,  plus  later  assumptions  regarding  detection  radius, 
raise  some  difficult  questions  of  validity  near  the  boundaries  of  a 
finite  operating  region.  These  questions  do  not  lend  themselves  to  easy 
analytical  treatment.  There  are  two  methods  of  treating  them.  The 
first  is  to  assume  the  errors  introduced  are  negligible  or  that  there 
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are  compensating  errors.  The  errors  will  certainly  be  negligible  if  the 
operating  area  is  large  enough.  An  example  of  compensating  errors  is 

i)  Target  density  within  detection  range  of  the  searcher 
will  be  less  on  the  boundary  of  operating  area  than 
within  the  area  \iue  to  the  fact  that  part  of  the  area 
swept  by  the  searcher  has  zero  target  density), 

ii)  But  the  searcher  will  know  this  and  concentrate  his 
efforts  accordingly. 

The  second  method  of  treatment  is  to  drop  explicit  consideration  of  area 
and  numbers  of  targets  and  searchers  and  consider  only  densities  instead. 
This  approach  requires  only  minor  adjustment  of  details  and  will  be 
discussed  later. 

Certain  questions  regarding  the  above  situation  are  of  interest 

i)  How  long  does  it  take  the  searcher  to  find  a  high 
value  target  (i.e.,  what  is  the  mean  time)? 

ii)  How  many  decoys  are  encountered  before  an  HVT  is 
found  (i.e.,  mean  number)? 

iii)  What  are  the  relative  effects  of  decoy  characteristics 
such  as  number,  speed,  detectability,  and  realism 
(classification  time)  on  the  quantities  in  (i)  and 
(ii)  above? 

iv)  How  many  decoys  with  the  given  characteristics  are 
required  to  provide  a  certain  level  of  safety  for 
the  high  value  targets  (e.g.,  provide  a  certain 
minimum  level  of  probability  of  an  HVT  being  detected 
over  a  specified  time  interval)? 

The  above  notions  are  random  in  nature  and  will  be  discussed  in  terms  of 
semi-Markov  random  processes. 

The  problem  of  search  in  the  presence  of  decoys  naturally  lends 
itself  to  representation  by  a  semi-Markov  process  because  the  state  of 
the  searcher  and  the  transitions  between  states  are  well  defined. 
Although  the  necessary  assumptir  is  for  a  continuous  time  Markov  chain 
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con  be  intuitively  justified  in  some  cases,  placing  the  problem  in  the 
format  of  a  more  general  semi -Markov  process  provides  a  framework  which 
can  accept  experimental  data  that  might  not  be  well  adapted  to  the 
more  specialized  Markov  chain.  Moreover,  the  semi-Markov  process  allows 
us  to  look  into  some  of  those  cases  that  definitely  do  not  meet  the 
assumptions  of  the  Markov  process.  Analysis  of  "sprint-drift''  is  a  case 
in  point.  In  sprint-drift  holding  times  in  certain  states  are  bounded 
and  the  ensuing  results  are  of  a  form  that  is  quite  different  from  the 
results  obtained  if  one  assumes  all  holding  times  are  (unbounded) 
exponentially  distributed. 

A  primary  feature  of  the  work  reported  on  herein  is  that  the 
solutions  to  the  various  models  considered  are  in  an  easily  calculable 
closed  form.  For  example,  all  matrix  inversions  required  for  model  so¬ 
lutions  have  been  carried  out  in  symbolic  manipulations.  Parametric 
studies  are  therefore  inexpensive  to  conduct.  Extension  of  the  work 
reported  here  to  more  complicated  state  spaces  or  distributions  may  or 
may  not  require  more  complicated  numerical  methods. 

Analysis  begins  in  Section  2  with  a  review  of  Koopman's  formula  for 
detection  rate.  A  general  discussion  of  semi -Markov  processes  follows 
in  Section  3.  A  three-state  search  model  with  constant  speeds  is  devel¬ 
oped  in  Section  4,  and  some  sample  results  are  given  in  Section  5.  A 
four-state  model  for  a  variable  speed  searcher  is  developed  in  Section  6. 
Finally,  conclusions  and  recommendations  are  given  in  Section  7;  where 
several  model  extensions  and  optimization  studies  using  the  models  are 
suggested . 


2.  DETECTION  RATE  AND  TIME 


From  Ref.  3  'uc  adopt  a  model  for  determining  rate  of  detection. 

The  following  assumptions  are  made 

i)  The  searcher  is  progressing  on  its  course  at  constant 
velocity  u 

ii)  The  searcher  is  moving  among  a  uniform  random  distri¬ 
bution  of  targets  with  uniformly  randomly  distributed 
headings 

iii)  The  targets  are  progressing  8t  constant  velocity  v 

iv)  The  density  of  targets  is  6  (targets  per  square 
nautical  mile,  say) 

v)  The  searcher  immediately  detects  8ll  targets 

which  come  within  a  range  R  (i.e.,  definite  rang-: 
rule)  . 


Then  the  rate  p  (i.e.,  number  per  unit  time)  at  which  targets  are 
detected  is  given  by 


(2.1) 


where 


P 


k 


4R6 

TT 


Ti 

f 

J  O 


(u+v)  }  \fl  -  k2  sin2 


cp  dec 


2  /uv 
U-rV 


and  the  integral  is  known  ss  the  complete  elliptic  integral  of  the  second 
kind.  Polynomial  approximations  for  this  integral  may  be  found  ir.  Ref.  6 
<p  592). 

Mean  time  to  detection  is  given  cv  the  inverse  rat®,  i.e,.  l'o. 

Some  example  mean  times  are  given  in  Table  2-1  for  various  ranges 
and  speeds.  The  target  density  is  equivalent  to  one  target  per  ~(200)s 
square  nautical  miles.  Ranges  are  nautical  miles  and  speeds  In  knots. 

For  example,  a  searcher  speed  of  20  kt,  a  target  speed  of  15  kt,  and  a 
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Table  2-1 


MEAN  DETECTION  TIME  (HOURS) 


o 

a 


3 

•a 

0 

o 

O. 

w 

u 

o 

JS 

o 

(3 

a 

OT 


Target  Speed  (v)  -  Knots 


5 

10 

15 

20 

25 

30 

5 

328.99 

196 .92 

135.82 

103  10 

82.95 

69.33 

10 

196.92 

164.49 

125,27 

98.46 

80.52 

67.91 

15 

135.82 

125.27 

109.66 

91.34 

76.70 

65.64 

20 

103 . 10 

98.46 

91 .34 

82.25 

71.74 

62.64 

25 

82.95 

80.52 

76.70 

71  .74 

60.80 

59.02 

30 

69  .33 

67.91 

65.64 

62.64 

59.02 

54.83 

R  =  30 

.0  nmi 

5 

164.49 

98.46 

67.91 

51.55 

41.47 

34.67 

10 

98.40 

82.25 

62.64 

49.23 

40.26 

33.96 

15 

67.91 

62.64 

54.83 

45.67 

38.35 

32.82 

20 

51.55 

49.23 

45.67 

41.12 

35.87 

31.32 

25 

41.47 

40 . 26 

38.35 

35-87 

32.90 

29.51 

30 

34,67 

33.96 

32.82 

31.32 

29.51 

27,42 

( 

R  -  60.0  nmi 

5 

109.66 

65.64 

45.27 

34.37 

27.65 

23.11 

10 

65.64 

54.83 

41.76 

32.82 

26.84 

22.64 

15 

45.27 

41.76 

36.55 

30.45 

25.57 

21.88 

20 

34.37 

32.82 

30.45 

27.42 

23.91 

20.88 

25 

27.65 

26 .84 

25.57 

23,91 

21.93 

19.67 

30 

23.11 

22.64 

21.88 

20.8° 

19.67 

18.28 

R  =  90.0  nmi 


6  = 


"(200) 2  targ2ts  per  sc5uare  nmi) 
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detection  range  of  30  nmi  yield  a  mean  detection  time  of  91.34  hours. 
For  interpolation  and  extrapolation,  inverse  mean  time  (rate)  is  linear 
in  range  and  target  density. 

Simulation  studies*  have  shewn  tha'  formula  (2.1)  works  quite  well 
for  a  200-nmi  radius  circular  area  under  the  following  condition.  A 
given  vehicle  (target  or  searcher)  pursues  a  randomly  selected  heading 
until  the  area  boundary  is  reached,  where  a  new  random  heading  within 
the  area  is  selected  ana  followed  until  the  boundary  is  again  reached, 
and  so  on . 

Finally  it  is  noted  that  no  distinction  is  made  here  between  the 
state  of  nature  and  the  searcher's  state  of  knowledge  of  the  state  of 
nature,  so  that  detection  is  synonymous  with  encounter. 


E.  L.  Wong;  "Simulation  Model  of  Search  in 
NWRC  TN-33 ;  SRI  Projec  1016-245,  Contra-.  *■ 
Research  Institute,  Memo  Park,  California 


the  Presence  of  Decoys/' 
N00014-7 l-C-0119 ;  ,tar.ford 
.  July  1971 
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3.  THE  SEMI -MARKOV  PROCESS 


3 . 1  Definition 

The  semi-Markov  process  (SMP)  is  a  stochastic  process  in  which  time 
is  the  independent  variable,  and  the  dependent  variable  can  assume  only 
a  denumerable  number  of  discrete  values.  A  given  value  of  the  dependent 
variable  is  called  a  state,  and  the  collection  of  all  possible  values  is 
the  state  space.  Transition  from  a  present  state  to  a  future  state  de¬ 
pends  only  on  the  present  state,  while  the  time  required  for  such  a 
transition  may,  in  general,  depend  on  both  the  present  state  and  the 
future  state.  Consider  a  space  of  functions  X  =  {x^(t);  t  ^  0,  aieO}  . 

This  space  is  the  sample  space  and  consists  of  functions  of  time,  with 
the  generic  functional  form  parameterized  by  U)eO.  Thus,  a  sample  "point" 
consists  of  the  set  of  points  fx^(t);  t  ^  0} ;  such  a  sample  point  is 
called  a  "realization"  of  the  process  and  will  be  denoted  simply  x  v • ) • 

CJU 

We  will  consider  only  a  finite  number  of  states,  with  a  state  denoted  by 

one  of  the  numbers  1,  2,  ....  N.  Thus,  for  a  fixed  value  of  t, 

x^(t)e  { 1 , 2 , . . . ,N} .  Hence,  it  is  characteristic  of  the  process  that  each 

realization  x  (•)  is  a  staircase  function;  we  will  assume  each  realization 
cu 

continuous  from  the  right.  This  assumption  is  not  universal.  For  example, 

Cox  and  Miller  (Ref.  1)  analyze  SMPs  which  are  continuous  from  the  left, 

although  they  also  consider  separately  in  some  detail  the  special  case  of 

Markov  processes  (MP)  which  are  continuous  from  the  right.  A  typical 

realization  is  plotted  in  Fig.  3-1  for  a  four-state  SMP.  The  dots  in  the 

figure  represent  "events,"  that  is,  points  where  a  transition  into  a  state 

occurs.  Transitions  from  a  state  into  the  same  state  may  occur.  If  a 

transition  from  state  i  to  state  j  (i  ^  j)  occurs  at  time  t,  then  x  (•) 

0) 

will  be  continuous  from  the  right  but  discontinuous  from  the  left 
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at  t  =  t  . 


Formally,  we  say  the  process  is  in  state  j  at  time  t  if  the 
last  event  to  occur  was  of  type  j,  where  je  {l . n} . 


FIGURE  3-1  A  TYPICAL  REALIZATION  OF  A  SMP 


A  SMP  is  often  described  in  terms  of  what  is  called  a  semi-Markov 
matrix  F  =  [f  (t)],  where  F  (t)  is  a  distribution  function  (or  sub- 

ij  ij 

distribution  function)  and 


F.  . (t-t  )  =  Pr{ x(t  )  =  j 

ij  n  n+1 


t  ^  1 1  x ( t  )  =  i} 

n+1  n 


where  t  is  the  random  variable  denoting  the  lime  the  process  makes  the 
th  n 

n  transition  (Refs.  8  and  9). 


However,  an  alternative  method  (Refs.  1  and  10)  more  appropriate 

for  our  purposes  is  to  describe  the  process  in  terms  of  a  transition 

probability  (stochastic)  matrix  A  =  (or,  .)  and  a  probability  density 

*  J 

function  (p.d.f.)  matrix  f  =  [f.  ,(t)]. 

ij 
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We  have 


aij  =  pr{next  event  is  of  typo  jjlast  event  of  type  i} 
and  where 

=  Probability  density  function  of  transition  time 
given  that  last  event  was  type  i  and  next  event 
is  type  j  . 

The  special  case  where  f  (t)  is  an  exponential  distribution, 

*  J 

depending  only  on  i,  is  a  continuous  time  Markov  process.  This  formu¬ 
lation  of  the  continuous  time  Markov  processes  differs  somewhat  from  the 
so-called  minimal  process  formulation  given  in  Refs.  1  and  2.  A 
limited  discussion  of  the  minimal  process  approach  is  given  in  Appendix  D. 

3.2  Characteristics  of  the  SMP 

We  now  proceed  to  discuss  and  develop  some  interesting  character¬ 
istics  of  semi-Markov  processes.  Cox  and  Miller  (Ref.  1)  show  the 
following.  If  we  let 

h  (t)  =  lim  Meyent  of  type  j  in  (t,  t+At)levent  of  type  i  at  0} 

ij  At  -  0  ^  - 

then  the  conditional  (on  event  type  i  at  0)  expected  number  H  (t)  of 
,  .  ij 

type  j  events  in  (0,  t)  is  given  by 

/.t 

(3a)  H  ft)  =  /  h.  (T)dT  . 

ij  J0  U 
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If  we  denote  the  Laplace  transform  of  a  general  function  m(x)  by 


CO 

j  (*  —  sx 

rr,  ( s)  -  •  e  m(x)dx  and  introduce  matrix  notation,  then 


X 


(3.2) 


h*(s)  =  [h*.(s)] 

ij 


g*(s)  [I  -  g*(s)] 


-l 


where 


g*  .(s)  ■  ct.  .f?  .(s) 

ij  ij 

Furthermore,  from  the  well-known  properties  of  the  Laplace  transform  we 
have 

(3.3)  H* .  (s)  =  -  h*.(s) 

ij  s  ij 

and  H(t)  may  be  obtained  by  inverting  the  transforms.  Cox  and  Miller 
derived  expression  (3.2)  in  the  context  of  a  SMP  continuous  from  the 
left,  whereas  ours  are  continuous  from  the  right.  However,  inspection 
of  their  derivation  shows  that  the  direction  of  continuity  is  irrelevant. 

We  say  the  system  is  in  state  j  at  time  t  if  the  last  event  to 
occur  before  (or  at)  t  was  of  type  j.  Let 


P.  .(t) 
ij 


Pr{in  state  j  at  time  t| event  of  type  i  at  time  o} 


and 


P(t)  =  [p.  ,(t)] . 

l  j 


Cox  and  Miller  also  develop  an  expression  for  P(t) .  However,  this 
derivation,  un  contrast  to  that  for  h*(s),  is  heavily  dependent  on  the 


12 


direction  of  continuity.  We  proceed  now  to  develop  an  expression  for 
sP*(s)  via  integral  equations  in  a  manner  similar  to  Cox  and  Miller. 

We  start  with  a  two  state  process.  The  integral  equations  arc  of 
the  form 


(3.4)  pu(«)  =  «uFu(t>  *  «12V°  +  / 


h  (t-u)F  (u)du 


"12  /  \i(t'u)Vu)du 


(3 .5) 


P12(,>  * 


.  r 

22  / 


r 

h12(t_U>F22(u)dU  +  a21  f  h12(t-u>F21<u)du 

0  *4>  ‘  1 


where 


(3.6) 


PiJ(t> 


c 

■  / 


f  (u)du 


One  obtains  p2^(t)  and  p  (t)  in  an  obviously  similar  manner. 

To  understand  the  derivation  of  (3.4)  and  (3.5),  one  should  study 
Figs.  3-2  through  3-4.  Figure  3-2  represents  the  Cox  and  Miller 
derivation  of  p  (t),  while  Figs.  3-3  and  3-4  correspond  to  our  deri¬ 
vation  of  p  (t)  and  p  (t) ,  respectively.  The  multiple  components  of 
11  12 

each  of  the  figures  represent  an  exhaustive  classification  of  the  ways 
in  which  the  desired  state  can  be  reached  at  time  t.  The  expressions 
on  the  right  of  the  figures  represent  corresponding  components  in 
integral  equations. 
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FIGURE  3-2  p  It)  CONTINUOUS  FROM  LEF-"  ICox  &  Miller) 


& 


all  J  hll 

G 

r z 

*21  J  V 

o 


FIGURE  3-3  p  (t)  CONTINUOUS  FROM  RIGHT 


-u)F^(u)du 


-u)F  (u)du 
I  ^ 


-u)F92(u)du 


-u)F2i(u)du 


FIGURE  3-4  p  (t)  CONTINUOUS  FROM  RIGHT 


Note  that 


F.^(t)  =  Pr{ the  transition  from  i  to  j  takes  c  or  longer] 

Thus  in  (3.4)  p^(t)  consists  of  the  components 

a  F  (t)  =  Pr{lst  transition  is  to  state  1  and  takes  t  or  longer] 

11  11 

ai2^1°^t^  =  transition  is  to  state  2  and  takes  t  or  longer] 


f  h  (t-u)ff  F  (uldu 
J  11  11  11 


j  Pr{lst  transition  leads  to  a  sequence  of  events  yielding 
*^o  an  event  1  at  t-u  followed  by  a  transition  to  state  1 
taking  u  or  longer] du 


t 

I 


hU<t‘U)C'l2F12(“)d" 


-l 


Pr{lst  transition  leads  to  a  sequence  of  events  yielding 
an  event  l  at  t-u  followed  by  a  transition  to  state  2 
taking  u  or  longer]du. 


Note  the  general  classification 
occurs  before  or  after  time  t. 
transition  must  occur  before  t. 


according  to  whether  the  first 

In  determining  p  (t),  i  ^  j, 
ij 


transition 
the  first 
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In  a  three  scate  process  we  have 


fp*  (s)  =  a  F*  +  a  F*  +  a  F*  +  a  h*  F*  +  a  h*  F*  +  a  h*  F* 

ril  II  11  12  12  13  13  11  11  11  12  11  12  13  11  13 


(3.10)  <p*  (s)  =  a  h*  F*  +  a  h’  F’  +  a  h*  F* 

Xi12  21  12  21  22  12  22  23  12  23 


So  it  is  clear  that  (3.9)  generalizes  to  the  11-dimensional 


(3.11)  sP*(s)  =  [i  +  h*(s)]w(s) 

where 

[w  (S>] 

t,  •  1  -  J 

k=l 

w  (s)  =0  ,  i  t  j 

J 

Note  in  the  special  case  where  f  =  f  for  all  (i,  j),  we  have 

xj  i 

W  =  1  -  f*.  Recall  h*(s)  is  given  by  (3.2). 

Now,  suppose  an  event  of  type  i  occurs  at  time  t  =  0.  Let  T  be 

the  (random)  time  the  system  first  reaches  state  j;  T _  is  thus  referred 

to  as  the  conditional  (on  i)  first  passage  time.  We  would  like  to 

develop  an  expression  for  the  expected  value  E(T  ).  Adapting  a  method 

ij 

used  by  Cox  and  Miller  (Ref.  1,  p  196)  for  Markov  processes,  we  proceed 

as  follows.  Replace  the  matrix  \  =  (a^)  by  =  (of^)  with  o?k  =  a ^ 

except  o P  =0,  k^j,  k  =  1,  ...,  n  and  aP.  .  =  1.  Thus  j  becomes  an 
jk  j  j 

"absorbing'1  state — once  the  process  reaches  state  j,  it  stays  there, 

although  the  event  j  may  reoccur.  Let  the  new  sample  space  be 

Y  =  fy  (t) ;  t  £  0,  weft].  Let  r  (t)  be  the  probability  in  the  new 
oj  ij 


W(s)  = 

W4 . (s)  = 

ii 
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process  that  state  j  is  occupied  at  time  t  if  started  with  event  i  at 

time  0.  Thus  r  (t)  in  the  new  process  corresponds  to  p  (t)  in  the  old 
ij  ij 

process  and  r.,(0)  =  1.  Then 
Jj 

(3.12)  P(T  .  £  t)  =  r  ft) 

ij  ij 

Note  that 

(3.13)  P(T  ^t)  =  P(u;eO|x  (0)  =  i,  x  (T)  =  j,  x  (t)  *  j,  all  T  <  T,  some  T  <  t) 

ij  1  a)  o> 

and 

(3.14)  r^(t)  ~  P(lhen|y^(0)  =  i,  y^(t)  =  j) 

By  construction  we  have  y  (0)  =  i  <=>  x  (0)  =  i  and 

0)  O) 

y  (t)  =  j  <=>  (x^(T)  =  j>  sc^Ct)  ^  j,  all  T  <  T,  some  T  <  t)  .  So  the  set 
of  wefl  in  (3.13)  and  the  set  of  (ten  in  (3.14)  are  the  same,  and  hence 
the  probabilities  are  the  same.  (We  have  assumed  the  probability 
measure  on  0  is  the  same  in  the  new  prosess  as  in  the  old.) 

Now  we  have 


(3.15) 


os 


e  Stp'  (T  £  t)dt 

•  J 

e"StV  (t)dt 
ij 


=  sr  (s)  +  r  .(+  0) 
ij  ij 


=  sri j (s> 
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where  the  last  equality  holds  because  we  assume  no  instantaneous 
transitions  at  t  =  0  can  occur,  that  is,  f,  .(t)  has  no  probability  mass 


concentrated  at  t  =  0. 


ij 


To  obtain 


E(V 


we  note  that 


(3.16) 


ds 


■L ST «) 


-  E‘V 


s=0 


One  is  now  tempted  to  write 


(3.17)  E(T  ) 
i  0 


but  sr'*(s) 
J  J 


may  be  indeterminate,  i.e.,  r',*(0)  =  So  the  entire 


s=0 


iJ 


function  sr*  (s)  must  be  developed, 
ij 

Thus  we  have  developed  formulas  for 


p.  .(t)  =  time  dependent  transition  probability 

^  J 

II  (t)  =  conditional  expected  number  of  events 

ij 


E(T  )  =  conditional  expected  first  passage  time, 

ij 


3 .3  Initial  State  Probabilities 

So  far  the  discussion  of  the  SMP  has  centered  on  the  transition 
mechanism  and  the  associated  conditional  probabilities,  conditional 
times,  and  conditional  events,  whore  the  conditioning  has  been  on  the 
initial  state  of  the  process.  If  the  probability  distribution  of  the 
initial  state  is  specified,  then  these  conditional  quantities  can  be 
combined  in  weighted  averages  to  obtain  the  corresponding  unconditional 
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quantities.  Suppose  we  have  the  state  space  S={l,  2,  ....  N}.  Let 

p^(t)  denote  the  probability  of  being  in  state  ieS  at  time  t  s  0.  The 

probability  distribution  of  the  initial  state  assigns  a  probability 

p^(0)  =  p^  such  that  p^  =  1.  The  t^me  dependent  state  probability 

p.(t)  is  distinct  from  the  time  dependent  transition  probability  p  (t) ; 
1  ij 

the  row  vector  of  p^(t)  is  denoted  by  p(t),  and  the  matrix  of  p.  ,(t)  by 
P(t) .  Note  that  for  the  "well-behaved"  processes  under  consideration 
P(0)  =1.  We  now  have 


(3.18) 


N 

p.(t)  -  p.co)p  (t> 

J  H  1  ,J 


for  t  £  0 


or 


(3.19) 


p(t)  =  p(0)P(t) 


for  t  s  0 


Similarly,  if  we  define 


H  (t) 
J 


unconditional  expected  number  of  type 
j  events  in  (0,  t) 


T  =  the  time  the  system  first  reaches  state  j 

o 


then 


(3.20) 


N 

& 

N 


H  ft)  =  V  p. (0)H,  (t) 

j  £«  i  ij 


E(T  )  =  T  p  (O)E(T  ) 

3  i=l  "  3 
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4.  A  THREE -STATE  SEMI -MARKOV  SEARCH  MODEL 


4 . 1  Definition 

Referring  to  the  operational  situation  described  in  Section  1  and 
the  semi-Markov  process  described  in  Section  3,  the  following  identifi¬ 
cations  yield  a  model  of  the  search  process  with  decoys  present. 

Let  the  events  be 

1.  Start  search 

2.  Start  classifying  a  decoy 

3.  Start  classifying  an  HVT. 

The  times  of  interest  are 

T  =  time  to  start  of  HVT  classification  given 
13 

searcher  starts  in  search  state 

T^3  =  time  to  start  of  HVT  classification  given 

searcher  starts  in  decoy  classification  state 

To  =  time  to  start  of  HVT  classification 
(unconditional). 

The  state  generated  by  event  (3)  is  considered  absorbing  because 

a.  Event  (3)  results  in  the  destruction  (or  probable 
destruction)  of  an  HVT 

b.  Hence  (3)  is  a  highly  significant  event  in  itself 

c.  In  the  cases  of  interest  in  the  present  study,  loss 
of  one  of  the  small  number  of  HVTs  would  cause  sig¬ 
nificant  changes  in  HVT  density,  which  in  turn  would 
require  considerable  extension  of  the  model. 

Note,  however,  that  (3)  being  an  absorbing  state  has  no  direct 
consequences  on  the  interesting  output  except 

a.  On  the  form  of  H  (t)  and  H  (t) 

12  22 

b.  On  the  interpretation  of  T  and  T  as  absorbtion 

,  lO 

times . 
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Preceding  page  blank 


It  would  be  a  very  straightforward  modification  to  consider  (3)  to  be 
other  than  absorbing.  A  situation  of  interest  in  this  case  would  be 
where  the  searcher  is  interested  only  in  surveying  the  field  of  targets 
to  determine,  for  example,  the  number  or  density  of  HVTs.* 

In  the  absorbing  case,  we  postulate  the  transition  matrix 


(4.1) 


and  the  probability  density  function 


(4.2) 


Here  the  densities  are 


f^(t)  =  p.d.f.  of  the  time  to  detect  a  target 

f  (t)  =  p.d.f .  of  the  time  T  to  classify  a  decoy 

f  (t)  =  p.d.f.  of  the  time  t  to  classify  a  HVT 

3  3 

and  the  conditional  probabilities  are 

a  =  probability  the  detected  target  is  a  decoy 
a  =  probability  the  detected  target  is  a  HVT 


*  An  interesting  problem  is:  given  such  a  model  and  a  search  history, 

what  are  good  estimates  of  density  or  number.  Assume  speeds  and  detection 
ranges  are  measured  with  error. 
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O'  =  probability  return  to  search  after  classify 

a  decoy  (i.e.,  no  HVT  or  other  decoy  present) 

&22  =  probability  that,  after  classify  a  decoy, 

another  decoy  is  present  and  selected,  from 
the  field  of  visible  targets,  to  be  classified 

c*22  =  probability  that,  after  classify  a  decoy,  an 

HVT  is  present  and  selected,  from  the  field 
of  visible  targets,  to  be  classified. 

Note  that  since  the  columns  of  the  matrix  f  are  identical  we  have  a 

Markov  process  if  the  f.’s  are  exponential.  The  characteristics  of 

f  (t)  other  than  finite  expected  value  turn  out  to  be  irrelevant  to 
o 

any  of  the  subsequent  analysis  due  to  the  fact  that  nothing  of  interest 
(in  the  present  model)  happens  after  state  3  is  reached;  let  u"1  be  the 
expected  value.  If  the  model  were  modified  to  a  nonabsorbing  situation 
(for  example,  to  include  HVT  mission  consideration),  then  f„(t)  would 
acquire  more  importance. 

We  assume  that  all  decoys  are  identical  and  all  HVTs  are  identical 
in  their  operating  characteristics.  A  decoy  may  have  characteristics 
different  from  an  HVT.  If  more  than  one  type  of  decoy  or  HVT  is  re¬ 
quired,  modification  of  the  subsequent  analysis  is  required.  Specifi¬ 
cally,  additional  states  and/or  modified  transition  probabilities  would 
be  required,  depending  on  the  type  of  information  required.  Many  types 
of  information  can  probably  be  obtained  through  modification  of  the 
transition  probabilities. 

4.2  Conditional  Expected  First  Passage  Time 

Referring  to  equations  (3.2)  and  (3.11)  we  have 

(4.3)  sP*(s)  =  [l  +  h*]  W(s) 
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where 


(4.4) 


W(s> 


1-f*  0  0 

0  1-f*  o 

2 

0  0  1-f* 

3J 


(4.5) 

and 


(4.6) 


Thus 


(4.7) 


h*(s)  =  g*(s)[l  -  g*(s)]-1 


g*(s) 


'  0 

Of  f  * 

n/  P* 

12  1 

“13*1 

Of  f  * 

a  f  * 

a  f  * 

21  2 

22  2 

23  3 

0 

0 

f* 

_ 

3 

I  -  g*(s) 


-a 


21  2 
0 


-a  f* 

-Of 

12  1 

\-a  f* 

-a 

22  2 

0 


f  * 
13  1 

f  * 
23  2 


1-f 


A 


1 

b 

1 

0 


b 

2 

0 


a 

3 


b 

3 


c 

3 
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CO  * 


So  we  can  write 


(4.8)  [l  -  g*(s)]’1  4 


’gll 

g12 

— 

S13 

g21 

S22 

g23 

0 

0 

g33- 

r 

b2 

~a2 

a  b  -a  b 

2  3  3  2 

b  -a 
2 

b 

2  1 

b  -a 

2  2 

b  c  (b  -a  b  ) 

1  3  2  2  1 

-b 


a  b  -b 
3  1  3 


b  -a  b  b  -a  b  c  (b  -a  b  ) 
221  221  3  22  1 


Noting  that  in  the  terminology  of  Section  3  we  now  have  p^(t)  =  r^(t) 

and  p  (t)  =  r  (t),  we  proceed  to  get  E(T  )  and  E(T  )  by  using  equation 

13  23 

(3 . 16)  .  We  have* 


(4.9) 


sP*  (s)  =  [I  +  h*]  W 


13 


1*  »3 


=  [I  +  h*]  W 


13  33 


since  W  =  W  =0 
13  23 


=  h*  W  =  W 


3g*/s)  [i  -  g*(s)];1 


=  «  f*] 

33  12  1  13  1 


13 


23 


Lg33J 


=  (l-f*)f*  (a  g  +  a  g  ) 

3  1  12b23  13b33 


Notation:  A  and  A.  refer  to  jth  column  and  the  ith  row,  respectively, 
oi  the  matrix  A. 
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where 


(4.10) 


of  +  a  a  f  f 
23  2  21  13  1  2 

(1  -f *)  Cl-o-  f*-a  a  £*f*) 
3  22  2  12  21  1  2 


So 


(4.11) 


spi3(s) 


_  * 

a  i  + 
13  1 


(a  a  -ct  a 
12  23  13  22 


)f*f* 


1  -  a  f 


22  2 


a  a  £*£* 
12  21  1  2 


Differentiating  with  respect  to  s,  negating,  setting  s  =  0,  and  using 

f*(0)  =  1  and  f*  *(0)  =  -  E  (T  ),  we  find 
i  i  i 


(4.12) 


E<T13>  - 


4  tti2E(T2) 
“23  +  a2iai3 


In  working  with  the  a.  .'s,  the  following  identities  are  useful: 

*  *3 


l-o  -  a  ot  =  a  +  ct  a  -  01  ct 
22  12  21  13  12  23  13  22 


(4.13) 


=  a  +  ct  o < 

23  21  13 


and 


a  +  a  a  +  ct  ct  -  a  a 
22  12  21  12  23  13  22 


a 


12 
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Similarly,  we  find  that 


(4.14a) 


a 


r>  *  ^  n  * 

_f_  +  a  _a_  f  f. 


SP23(S> 


23  2 


13  21  1  2 


1  -  a  f  *  -  a  a  f*f* 
22  2  12  21  1  2 


and 


(4.14b) 


E<V 


“ai^V  +  E(V 

a _ +  a  a 

23  21  13 


Of  course. 


(4 . 14c) 


E(T33)  *  ° 


4.3  The  Transition  Matrix 


The  matrix 


is  comprised  of  the  transition  probabilities. 
Note  that 


(4.15) 


a  „  +  a 
12  13 


a  +  a  +  a 
21  22  23 


1 

1 


The  absorbing  nature  of  state  3  is  reflected  in  a  =1.  The  value  of 

33 

ck  =  0  is  implied  by  the  fact  t!.«*c  the  end  of  a  search  leg  is  marked 
by  the  detection  of  a  target  which  must  be  classified. 
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Fron:  (4.15)  we  see  that  once  Of  „  is  determined,  a  is  also 

12  13 

determined.  Also,  is  determined  by  and  Wo  Pr°ceed  to 

discuss  these  independent  quantities. 


4.3.1  Determination  of  a 


If  we  let 


n  =  number  of  HVTs 
c 


n^  =  number  of  decoys 


it  seems  natural  at  first  to  define 

n 


(4.16) 


a 


12 


n  +  n 
c  d 


This  procedure,  however,  neglects  the  effects  of  relative  detectability 
of  the  two  types  of  targets.  We  have  seen  in  Section  2  that  "detect¬ 
ability"  is  a  function  of  speed  and  detection  range  as  well  as  number 
or  density. 


An  alternative  procedure,  which  yields  a  result  equally 
intuitive  for  simple  assumptions,  '?  the  following.  Define  the  random 
variables 


Y  =  time  to  detect  a  decoy 
X  =  time  to  detect  a  high  value  target, 


Then 

(4.171 


a  »  P(Y  <  X) 

L  ^ 


-r 

Jq 


P(Y  <  X|X  =  x>Jt  (x)dx 
X 


.here  f  (x)  is  the  p.d.l.  o*  X,  and  in  the  following,  f  (y)  is  the  p.d.f 
X  * 
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of  Y.  The  value  of  a  thus  depends  on  the  forms  that  are  assumed  for 
the  p.d.f.'s.  We  consider  two  cases:  exponential  and  Erlangian  with 
parameter  k  =  2. 


®  Exponential  Case 
In  this  case 


f  (y)  =  (xe 

l» 

(4.17a) 

f  (x)  =  !pe"3x 

X  \ 


y  >  0 
otherwise 


x  >  0 
otherwise 


so 


(4.18) 


P(Y  <  X|X  =  x) 


P(Y  <  x) 


1 


-Xx 

e 


Hence 


(4.19) 


12 


(1-e  ^X)Pe 


Sx . 


Ox 


X 

X+g  ’ 

Since  X  is  rate  at  which  decoys  are  detected  and  3  is  rate  at  which 
HVTs  are  detected,  (4.19)  is  a  highly  intuitive  result. 
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It  is  of  interest  to  no  > 


(4 .20) 


E(Y)  =  - 


(Var(Y)  -  ^2 


E(X)  =  - 


Var(X)  = 


•  Erlangian  Case 


The  Erlang  distribution  is  discussed  in  Ref.  5  (Hillier 
and  Lieberman,  pp  303-304).  It  should  be  noted  that  the  Erlang  distri¬ 
bution  is  similar  to  the  gamma  distribution  but  they  are  not  different 
names  for  the  same  thing.  Although  they  have  the  same  "shape,"  custom 
has  the  parameters  arranged  with  slight  differences.  If  Z  is  a  random 
variable  of  Erlang  distribution  with  parameters  m  >  0  and  k  >  0,  then 
the  p.d.f.  of  Z  is 


M.21) 


f  _  (s* I 

fzU)  "  T(k) 


k-1  -kmz 
z  e  dz 


for  z  ^  0. 


I  ,  1 

The  mean  and  variance  are  -  and  - — • 

r.  km 


Note  that  k  =  1  yields  the 
exponential  distribution.  Figure  4-1  exhibits  how  k  changes  the  shape 
of  the  distribution  for  a  given  m. 


FIGURE  4-1  ERLANG  DISTRIBUTION  FOR 
VARIOUS  VALUES  OF  k 
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We  consider  the  case  k  =  2.  Thus 


(4.21a) 


?  ~2\  y  . 

f  (y)  =  4X2 ye  y  •  0 

-  -2px  _ 

f  (x)  =  4p2xe  x  ?  0  . 

X 


So 


(4.22) 


x  -2Xx 

P(Y  <  x)  =  1  -  (2\x+l)e 


and 


_  ,  v  -2Xx,  _ 2  -20X, 

[l-(2Xx+l)e  J4j3  xe  dx 

(4.23) 

*  (X-f3g) 

(X+P)3 

We  note  that  if  X  =  {3  we  have  ot  =  which  is  intuitively  reassuring. 

It  is  useful  to  note  that  if  experimental  data  are 
available  and  appear  to  fit  the  family  of  Erlang  distributions,  the 
parameters  may  be  estimated.  It  seems  'ikely  that  the  only  other  type 
of  experimentally  derived  distribution  (in  the  context  of  what  we  are 
trying  to  model)  would  be  a  bimodal  (or  multimodal)  distribution.  In 
that  case  it  may  be  feasible  to  fit  the  data  with  a  mixture  of  Erlang 
distributions,  that  is,  a  distribution  with  p.d.f,  given  by 


Vz/v +  p2vv 


where  Z  and  Z  represent  two  different  Erlang  distributions  and 
1  2 

p  +p  =  1,  0  £  p  £  ,  0  s  p  £  1 .  Some  interesting  technical 

12  11  2 

questions  are  what  conditions  (if  any)  on  the  means  and  variances  of 
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and  ZQ  and  on  and  po  yield  a  bimodal  distribution?  and  what  are 
good  estimators  of  the  six  parameters?  (It  appears  that  maximum 
likelihood  estimators  may  be  very  nonlinear.) 

4.3.2  Determination  of  Detection  Rates 

The  computation  of  requires  determination  of  the  detection 
r-tes  X  and  3>  In  the  absence  of  experimental  data  or  for  ease  of  para¬ 
metric  analysis,  reliance  must  be  placed  on  equation  (2.1).  Specifically 


X  = 


4R  6 
d  d 


(V  ,+V  ) 


TT  d  S 


" > 

j  \Jl  -  lysin’ 


cp  dep 


2  ./TT 

V  r\ 


d  S 


1  V  +  V 
d  s 


(4.24)  < 


0  = 


4R  5 
c  c 


7T 
'  9 


n  (VC+Vs)  I  \Jl  "  k2sin2;P  dcP  ■  k 


. 

2  “  V  +  V 

c  s 


where 


"d 

5 


speed  of  searcher 
speed  of  decoys 
speed  of  RVTs 
detection  range  of  decoy 
detection  range  of  HVTs 
density  of  decoys 
density  if  HVTs 


c 

3  =  rate  at  which  searcher  detects  HVTs 

X  =  rate  at  which  searcher  detects  decoy. 

The  values  of  X  and  3  are  expressed  in  inverse  time  units, 
intuitively  be  considered  detections  per  unit  time. 


and  may 
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Two  approaches  may  be  taken  regarding  the  densities  i  and 
First  of  all,  the  situation  to  be  modelled  may  be  considered  purely  in 
terms  of  density  and  all  questions  of  specific  area  size  and  number  ol 


targets  ignored.  On  the  other  hand,  we  may  compute 

n 


6c  -  r 


(4.25) 


where 


n  =  number  of  high  value  targets 
c 

n  =  number  of  decoys 
d 

A  ••=  area  of  operating  region  containing 
o 

tne  targets. 

The  former  approach  may  be  more  theoretically  aesthetic,  Ahile  the 
latter  has  more  practical  application.  The  choice  of  alternatives  nere 
should  be  consistent  with  the  choice  made  in  the  next  subsection  for 

*22  an<l  “23 ' ' 

4.3.3  Determination  of  a  and  a 

_ 22 _ 23 

The  probabilities  a  and  a  ore  defined  by 

22  23 

/a,  =  Pr{next  event  is  "classify  decoy" [lost  event  was  "classify  decoy"} 

(4 . 25) ! 

(a  =  Pr{ next  event  is  "clnssily  HVT'|lost  event  was  "classify  decoy"  }. 


In  other  wore.s,  a  represents  the  probability  of  going  from  a  decoy  to 

iL  & 

another  decoy  end  a  the  probability  of  going  from  a  decoy  to  a  high 
value  target.  By  the  law  of  total  probability  or^ ,  representing  the 
probability  of  going  from  a  decoy  to  search,  is  given  by  1  -  a  -  a  . 


It  turns  out  that  certain  results  are  highly  sensitive  to 
a  1)4)  and  jr  .  Also,  certain  unexpected  and  unusual,  but  explicable, 
elfects  are  due  to  at).  .  Hence  a  high  degree  of  care  must  be  exercised 
in  specifying  ai)i}  and  . 

As  with  ,  *  here  are  two  approach.es  to  considering  aoo  and 
Ot  :  density  or  area.  In  addition,  there  is  the  question  of  adapting 
the  assumption  of  random  movement  to  movement  which  is  random  with  a 
condition  of  reduced  interaction  or  overlap"  on  the  targets. 


•  Area  Approach 

Consider  an  area  of  A  square  nautical  miles  containing 

o 

n  decoys,  n  high  value  targets,  and  one  searcher.  Assume  that  at  any 
d  c 

given  instant  the  decoys  and  HVTs  are  uniformly  distributed  at  random 
over  the  area. 


The  complete  classification  of  a  decoy  anticipates  an 
event.  The  next  event  to  occur  can  be  either  start  of  search,  start  of 
classification  of  (another)  decoy,  or  start  classification  of  an  HVT. 


In  order  for  the  next  event  to  be  start  of  classification 
of  another  decoy,  at  least  one  other  decoy  must  be  present  and,  if  one 
or  more  HVTs  are  also  present,  a  decoy  must  be  chosen  from  the  array  of 
tr.  rgcts . 


So 


(•1.27) 


Pfat  least  one  new  decoy  present  and  pick  decoy | just  finished 

a  decoy} 


n  -1 
d 


P{k  new  decoys  present  and  pick  decoyjjust  finished  decoy] 


k=l 


p  - 1  n 
d  c 


£  £  Pi k  new  decoys  present,  l  HVTs  present,  pick  decoy 

k=l  !,= 0  I  just  finisher'  decoy] 


i  .e. , 


(4.28)  a 

22 


k=l 


E 

l=o 


p  a-p  > 
a  d 


n 

d 


k 

Jt+k 


This  last  statement  follows  from 


(4.29)  p{k  new  decoys  present,  l  HVTs  present,  pick  decoy] 

=  P{ k  new  decoys  present]  •  P{2  HVTs  present] 

•  P[pick  decoy |k  new  decoys  and  2  HVTs  present] 

plus  the  assumption  that  the  motions  of  decoys  and  HVTs  are  stochastically 
independent  and  the  fact  ti.at 


P(A  n  n  o  C)  =  P(A  0  B)P(c|a  n  B)  =  P(A)P(B)P(c|a  O  B) 


if  A  and  B  are  independent  events  .  Also 

In  - T\  n  -1- 

P{k  new  decoys  present]  =  I  /Pk(l-P  )  d 

'  k  /  d  d 

(4.30)  P(2  HVTs  present]  =  |^Cjp^(l-P  ) 


n  -2 
c 


Pf  pick  decoyjk  new  decoys  and  2  HVTs]  = 

k+2 


and 


P  =  hr- 
c  c  o 


p 

d 


mr  /A 

d  o 
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P  is  the  probability  any  one  HVT  is  present  (within  range  of  the 
searcher).  P  is  analogous. 

In  a  similar  'manner  we  write 


n  -1  n 

d  c  ,  n  -l-k/n\  n  -l  . 

o.3i)  «,  =  T  V  ‘  ( f)p*ei-p  >  c  1 

23  i  t—i  '  k  /  d  d  \  1/  c  c 

k=0 


1+ k 


Note  the  difference  between  a  and  is  in  the  limits  of  summation 

22  23 

and  the  probability  of  picking  the  appropriate  target. 

Let's  consider  the  special  case  where  n  =1.  Then 

c 

(1.31)  becomes 


n  -1 
d 


a  /n  -lv  , 

y  —  ( d  )  pk  c  i  -f  ) 

,4*  k+l  \  k  /  d  d 
k=0 


(4.32)  a  =  P 
23 


n  -1-k 
d 


P  d  /n  \  , 

c  i  d  p,: 

n  \  k  /  d 


d  d  k=l 
P 


d  o  ) 
d 


n  -k 
d 


P  n 
d  d 


1  -  (1-P.) 
d 


Similarly,  (4.28)  becomes 


(4.33)  & 


22 


(1-P  ) 
c 


■£ro 


k=l 


n  -1-k 

P"(l-P  }  d 
d  d 


r  -1 

d  .  ,n  -1\  n  -1-k 

„  V'  k  /  d  I  k  .  d 

+  P  /  -  P  (1-P  ) 

c  i+k  \  k  /  d  d 


Ir- 


=  l 


=  (l- 


r  n  -ii 

p 

r  n 

,  d 

c 

d 

1  -  (1-P  ,) 

n  P  +  (1-P  )  -1 

d 

p  11 

_  d  d  d  J 

L  J 

d  d 
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It  is  also  clear  that  in  general 

(4.34)  a  £  Pr[ no  HVTs  or  new  decoys  present! just  finished  a  decoy) 

w  J. 

n  n  -1 

=  (1-P  )  C(1~P.)  d 

c  d 

The  case  n  -  1  now  makes  a  good  check  case  for  a  +  a  +  a  =  1 . 

c  21  22  23 


®  Density  Approach 

It  is  possible  to  drop  explicit  consideration  of  area 
and  number  of  targets.  Equations  (4. S'7)  and  (4.28)  still  ho  id ;  but  the 
binomial  distribution  is  replaced  by  the  Poisson  distribution.  The 
results  are 


(4.35) 


a 


21 


a 


=  m  y 


23 


=  m 


u  i  k  k  k 

x  V  (i±p>  y  -x 


k=l 


k(kl) 


a 


22 


1  -  a  -  a 
21  23 


where 


x  =  6  tir2 

c  c 

6  tut 

d  d 


y 

p 


=  x/y 


-x-y 


m  = 


1-e 


Details  are  given  in  Appendix  A. 
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8  Effects  of  Overlap 


One  of  the  main  assumptions  has  been  random  motion  cf  the 
targets  and  uniform  random  distribution  of  the  targets  at  any  given 
instant  in  time.  One  suspects  that  the  evader  might  improve  his  situation 
by  not  allo"ing  targets  to  congregate,  as  vi i  1  j  happen  occasionally  under 
purely  random  motion.  It  happens  that  this  suspicion  is  supported  by 
analysis  to  be  given  shortly.  On  the  other  hand,  one  also  suspects  that, 
as  the  target  density  increases,  it  becomes  increasingly  difficult  to 
prevent  congregation.  This  matter  will  be  discussed  also. 


Suppose  that  it  can  be  guaranteed  that  HVTs  are  kept  a 
sufficient,  distance  from  decoys  to  cause  a  =  0.  Compare  this  with  the 

•-  O 

situation  where  or  r  0,  i.e.,  normal  overlap.  Consider  the  case  where 

the  f  are  exponential  distributions  (the  Markov  process)  for  one  HVT. 
i 

V.’e  then  have 


(1.36)  E<Tjn(|  =  1,  a23  •  0)  >  Effjn,  =  1,  i  «> 

from  (4.12)  with  n  =  1.  That  is,  for  a  ?  0 
d  23 


(4.37) 


X+8 


a 


13 


_3_ 

>.fS 


o, 


a 


23 


P 

c 


so 

(4.38) 


E(T 


13,nd 


1, 


(B+P  >.).. 
c 


where 


is  the  mean  of  f^(t) 
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For  a  =  0 
23 


(4.39) 


„  _x_  _s_ 

12  X+»  ’  G13  \+p 


“21  =  *22  =  *2S  "  ° 


so 


(4.40) 


E(T  n  =  1,  a  =  0)  =  r 

'  ]  3  d  ’23  3 


+X 


The  inequality  is  now  clear.  Thus  the  evader  does  wish  to  separate  an 
HVT  and  a  decoy,  at  least  after  the  searcher  has  deployed  and  is  searching. 


®  Model  Restrictions  Due  to  Overlap 


Turning  to  another  question,  one  might  ask  whether  it  is 
always  of  advantage  to  the  evader  to  use  decojs.  If  the  decoys  and  tiVTs 
are  independent,  the  intuitive  answer  is  yes.  However,  the  model  some¬ 
times  answe-s  "Ko1."  There  are  reasonable  cases  where  E(T  |n  =  n)  and 

13  d 

E (T3 I nd  =  wil1  at  first  decrease  as  n  is  increased  from  zero.  This 
phenomenon  is  an  artifact  due  to  failure  of  the  random  motion/position 
assumption.  To  gain  at  least  a  partial  understanding  of  why  it  happens, 
let  us  examine  the  case  where  the  f  ^  are  exponential  distributions  (the 
Markov  process)  for  one  HVT  with  first  zero  and  then  one  decoy.  Consid¬ 
ering  first  T  we  have 


M.  41)  E  (i  In  =0)  =  i 

13 1  d  S 

and 


(4.^2) 


EC 


13 1  d 


1) 


(3+P  X) . 
c 


41 


1  wo  linvo 


since  with  n  = 
(1 


(•1  .*13) 


_  JL.  Q  _  JL 

12  "  UP  ’  13  “  X+P 


a 


a  -  l  -  P  ,  a  =  0 

W21  c  ’  22 


The  dosirnblo  aituntion  for  tho  HVT  is  E(T  „|n.  =>  \)  >  E(T  In  «  0).  We 

).  3  ’  (I  13  (I 

thus  roqulrn 


(4.4*1) 


_il±X _ _  >  i 

(P+P  X)t.  p 

c 


or 


(4.45)  P  >  |iP 

0 

The  relation  (4.45)  con  be  interpreted  os  follows.  At  the  beginning  of 

decoy  classification,  the  HVT  is  known  not  to  be  within  detection  range. 

As  long  ns  the  mean  classification  time  is  long  enough  (i.e.,  (4.45) 

satisfied),  then  this  initial  condition  will  dissipate,  and  tho  HVT 

position  will  be  uniformly  random  over  the  entire  area  at  the  end  of 

decoy  classification.  Failure  of  (4.45)  to  hold  means  the  HIT  speed 

(or  the  classification  time)  is  not  high  enough  to  dissipate  this  initial 

condition.  Notice  that  if  overlap  is  prohibited  so  that  a„  =  0,  then 
X  23 

(4.44)  becomes  —  >  0,  which  always  holds  (for  ail  practical  situations). 

M 

Now  consider  in  the  same  manner  we  have  just  examined 

T  .  Then 
13 

(4.46)  E(T In  =  0)  =  p  E(T  In,  =  0)  =  (1-F  )  ^ 

3  d  1  13  d  cp 
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since  p  =  1  -  P  when  nj  -  0,  and  from  (4.38) 
led 


(4.47)  E(T;||„d  =,  1)  =  -  .)  H-  P2«T23|„(1  -  ,) 

where  E('r13lnd  =  D  is  giver,  above  by  (4.42).  Substituting  the  values 
of  (4.43)  into  (4.14b)  we  get 


(4.48)  B(t|b  =  1) 

<43  d 


(l-P  )  +  X+3 
c 

|i(P  X+P) 
c 


(4.49)  E(T  In  =  1) 

3  cl 


P1(|i+X)  +  PgU  ( 1-P  )  +  p  (X+f3) 


2  c  2 

d(P+P  X) 
c 


Thus  in  order  to  have  E(T  In  =  1)  >  E(T  In  =  0)  we  require 

o  d  3 1  d 

(4.50)  P  P2  +  3  {p  (p+X)  +  p  [|.(1-P  )  +  X]  -  (l-p  )Mj  -  (i-p  )P  „x  *  o 

42c  cJ  cc 


or,  substituting 


a  =  P, 


(4.51) 


b  =  p  (p+X)  +  p  Cu(l-P  )  +  X]  -  (1-P  >M 

1  4  c  c. 


C  =  (l-p  )P  Mx  , 
c  c 


we  require 


(4.52) 


where 


(4.53) 


aj3s  +  bf}  -  c  2:  0 


a  >  0  ,  c  >  0 


! 

! 

i 


■•14..-  i . - . .-.-ua. 


Completing  the  square,  (4.52)  can  he  written  as 


(4.54) 


P(B) 


b" 

4a2 


a  0 


Now  p(B)  is  a  quadrate  form  in  B  with  two  real  r 


and  a  minimum  of - -  (i/;  +  4ac)  at  B 

4a' 


oots  -  ~  ±  —  yp2  +  4ac 
2a  2a 


2a 


.  Farther 


b‘-  +  4ac  >  b2 


since  a  >  0  and  c  >  0  so 


_1_ 

2a 


v/i^T 


4ac 


> 


_b_ 

2a 


and  hence 


P(0)  <  0  for  0  <  p  <  ±  {\/i7T4aC  -  bj 

(4.55) 

P(P)  so  for  B  *  ±  {fb*\  4ac  -  b}  . 


Since  E(T3|nd  =  l)  >  Edjn^  =,  0)  if  and  only  if  p(B)  £  0,  it  is  also 
possible  for  the  deployment  of  a  decoy  to  be  disadvantageous  to  the  HVT 
when  using  EOy  os  a  measure.  Unfortunately,  this  threshold  on  B  is 
not  as  easily  interpreted  as  when  using  E(T,,}.  However,  if  b  >  0  we 
note  that  b  +  \/4oc  >  /bs  +  4ac  end  hence  p(S)  >  0  if  B  >  \j^ .  In 

particular,  if  u  <  1  ’  mean  cJec°y  classification  time  is  greater 

than  1  hour)  and  if 


2p  <  P  then  tiP  > 
2  c  c 


Vf  since 


>  u ;  moreover , 
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P  >  P  n  implies  0  >  \/~  .  Nonce  in  this  cose,  nnv  3  good  !’or  K(T  ) 

c  vo  ■  i  a 

is  good  for  E(T  )  ,  and  there  may  be  n  range  of  3  good  for  K(T>$)  which 

is  not  good  for  E(T  ).* 

1  J 

I •  ' is  not  permitted  so  that  a  -  0,  then  since 

in  this  case  p  =  P  instead  of  (4.50),  we  have  merely  (p.  +  p  )X  i  p  3  2  0 
3  c  '13  2 

which  always  holds. 

To  summarize  thus  far,  if  overlap  is  permitted  wo  must 

check  that  [3  £  pP  and  p(3)  s  o  to  guard  against  the  failure  of  the 
c 

random  position  assumption.  It  is  useful  to  note,  however,  that  os  the 
number  of  decoys  increases  this  problem  will  diminish  becau  .e  eventually 
the  target  selection  problem  will  overshadow  the  error  In  the  probability 
of  the  IfVT  being  present.  Possibilities  for  removing  these  restrictions 
are  discussed  in  Section  7. 

Unfortunately,  these  conditions  alone  are  neither 
necessary  nor  sufficient  to  guarantee  the  accuracy  of  the  model,  even 
though  the  preceding  discussion  may  seem  to  imply  them.  The  reason  is 
that  a  further  problem  remains  in  the  fact  that  after  having  classified 
a  decoy  and  returned  to  search,  the  search  rate  is  not  X+3  immediately. 

In  the  case  of  a  single  decoy  the  search  rate  is  simply  3  until  the 
effect  of  the  information  obtained  in  the  last  decoy  classification  has 
dissipated,  at  which  time  the  search  rete  is  restored  to  X+3.  In  the 

Sample  case:  anticipating  Section  4.7  we  have  for  n  -  1  that 

d 

P„  =  P,  +  P  [l-2P  1/2;  using  formulas  for  P  and  PJ  given  with  (4.30) 

6  O  C  Q  C  Cl 

and  letting  V  =  15,  V  =  Vj  =  20,  R  =  R  =  60,  we  get  X  <  .002 

s  c  d  c  d 

or  1/X  >  500;  from  Table  2-1  we  see  this  is  not  satisfied  since 

1/X  =  45.67;  since  this  is  a  typical  case,  the  bound  above  doesn't  say 

too  much. 
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cose  of  multiple  decoys,  t  lie  search  rate  immediately  after  classification 
Is  something  less  than  X.t-0  until  an  appropriate  time  for  restoration  to 
X18.  file  transition  probabilities  are  similarly  affected.  In  the  case 
whore  the  obtained  information  does  indeed  dissipate,  this  problem  is 
solvable  by  adding  another  state  to  the  model.  This  additional  state 
would  be  a  secondary  search  state  that  accounts  for  the  information 
dependency;  a  transition  to  the  primary  starch  sin.e  would  be  made  after 
a  suitable  length  of  time  if  the  HVT  is  not  found  in  the  interim.  The 
case  where  the  information  does  not  dissipate  (e.g.,  position  plotting 
of  stationary  decoys)  must  he  treated  in  a  different  manner.  A  possible 
approach  exploiting  special  matrix  structure  is  discussed  in  Section  7. 

•  Heouced  Overlap 

Earlier,  under  the  subheading  "Effects  of  Overlap"  it 
was  shown  that  it  may  be  advantageous  to  eliminate,  or  at  lease  reduce, 
overlap  between  HVTs  and  decoys.  We  now  consider  some  ways  of  incorpo¬ 
rating  this  reduced  overlap  into  the  model. 

Suppose  the  decoys  are  not  stationary  (i.e.,  are  mobile). 

Then  it  may  be  feasible  for  them  to  know  or  recognize  where  the  HVTs  are 

going  to  be  and  simplv  stay  a  suitable  distance,  call  it  R  ,  away  from 

s 

them.  Let  R  =  R  +  P  where  p  =  decoy  classification  range.  In  this 
s  c  d  d 

case,  if  p  ^  is  small,  a  simple  appre  situation  is  to  set  a ^  =  0.  (See 
the  end  of  Appendix  D  for  further  discussion  of  this  approach.) 

Suppose  now  that  the  decoys  are  stationary  or  that  it  is 
not  feasible  for  the  decoys  to  know  or  recognize  where  the  HVTs  will  be. 
Two  basic  methods  of  approaching  this  problem  have  been  considered.  Both 
require  that  an  HVT’  have  the  capability  to  recognize  and  avoid  a  decoy. 
The  first  method  is  a  queuing  model  which  requires  only  specification  of 
an  operational  parameter  reflecting  the  objectives  of  the  HVT'  activities. 


'16 


The  second  method  involves  a  class  of  models  winch  basically  requires 
estimation  of  a  parameter  describing  fleet  operations  oi  fitting  a 
curve  to  observed  data.  Since  the  first  method  seems  more  suitable  to 
the  course  of  the  current  analysis,  it  is  presented  hero  and  the  second 
method  is  discussed  in  Appendix  B. 

J et  A  ,  the  rate  at  which  KVTs  encounter  decoys,  be 
c 

defined  as 


(4.56) 


A 

c 


4R  n  n 
s  c  d 

TlA 


o 


(V  +  V  )  E 
d  c 


where  E(k)  is  the  elliptic  integral  discussed  in  Section  2.  Also 
define 


(4.57)  A  =  maximum  acceptable  rate  of  HVT  course  change 
o 

for  purpose  of  decoy  avoidance. 

For  example,  an  HVT  may  be  subject  to  constraints  such  that  it  would  be 

willing  to  change  course  to  avoid  a  decoy  on  the  average  only  once  in 

every  5  hours,  in  which  case  A  =0.2  hr  .  We  can  now  model  the 

o 

situation  of  a  single  HVT  as  a  single  server  queue  with  customer  balking, 

that  is,  when  the  customer  arrives  if  the  server  is  busy  the  arriving 

customer  leaves.  In  this  case  the  HVT  is  the  server  and  the  customer  is 

a  decoy.  The  customer  arrival  rate  is  A  and  the  service  rate  is  A  . 

c  o 

Customer  arrival  corresponds  to  HVT  contact  of  a  decoy.  Customer  service 
corresponds  to  the  length  of  time  after  a  decoy  avoidance  maneuver  before 
the  HVT  is  willing  to  make  another  such  maneuver.  Such  a  queuing  system 
can  be  represented  by  a  two-state  Markov  process,  where  the  states  0  or  1 
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correspond  to  the  number  of  customers  being  served  or,  equivalently, 
whether  or  not  the  server  is  busy.  The  process  can  be  represented  by 
the  generator  matrix 

L 

(4.38)  Q  =  c 

U 

'  o 

Let  B  denoce  "system  in  state  l-"  and  P  "system  in  state  0."  Assume 
the  system  is  in  steady  state.  Let  P(B)  =  Pr(B)  and  P(B)  =  Pr(B)  in 
steady  state.  Then  from  Ref.  2  (p  194)  we  have 

X 


X  +  X 
o  c 

X 


X  +  X 
o  c 


P(B)  = 

(4.39) 

P(B)  = 


We  refer  now  to  Fig.  4-2.  A  represents  the  area  tt(R  +  p  )2  and  A* 

s  c  d 

the  area  ttr2 ,  The  decoy  is  centered  in  A  ,  the  searcher  in  A*.  Denote 
c  s 

"lIVT  in  area  A"  by  "HeA."  We  assume  HeA  =5>  B  and  hence  P(HeA*  &  BjHeA  ) 

s  s 

and  P (Blue A  )  =  1.  Then 
s 


(4.60)  P(KeA* I HeA  ) 

s 


P(HeA*  &  BjHeA  )  +  P(HeA*  &  b|hcA  ) 
s  s 

P(HeA*  &  b|h€As) 

P(HeA* |b  &  HeAg)P(BjHeAg) 

P(HeA*|HeA  ) 
s 

A*/A 

s 

(R  /R  )2 
c  s 
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FIGURE  4-2  AREAS  IN  QUEUE  MODEL  OF  OVERLAP 


P(HcA  |B)  =  TT(R  +  p  )2/A 

s'  c  d  o 


P(HeA  )  =  P(HeA  &  B)  +  P(HeA  &.  B) 

s  s  s 

=  P(HeAs|B)P(B) 


We  interpret  P  as  P 
c  c 


P(HeA*).  Furthermore,  P(HeA*|H$A  )  =  0.  Hence 


<4.63) 


so 


P(HeA*)  =  P(HeA*|HeA  )P(HeA  )  •*•  P(H6A*|h$A  )P(H*A  ) 

s  s  s  s 


(4.64) 


P  (X  ) 

c  o 


TT(R  +  P  J2 
c  d 

A 

o 


X 

c 


a  +  X 
o  c 


nR  2  X 
c  c 

A  X  +  X 
o  o  c 


Note  that  p  enters  the  equation  through  X  .  We  can  now  substitute 
a  c 

W  for  pc  in  the  computation  of  or^  and  a .  This  approach  could 

perhaps  be  generalized  to  priority  queuing  system  with  balking  and  two 

typ 3S  of  customers,  decoys  and  HVT  activities,  where  che  HVT  activities 

have  priority  over  decoy  avoidance.  This  generalization  is  not  developed 

here  for  lack  of  time.  A  discussion  of  possible  error  due  to  a  failure 

of  the  implicit  assumption  that  A*/A  =  (R  /R  )2  is  given  in  Appendix  C. 

s  c  s 


4.4  The  P.D.F.  Matrix 

The  form  of  f  (t)  is  dependent  on  the  way  in  which  a  and  a  are 
1  12  13 

derived.  The  forms  of  f  (t)  and  f  (t)  may  be  specified  freely,  and,  as 
noted  previously,  the  form  of  f  (t)  is  irrelevant. 

v 

Referring  to  the  discussion  surrounding  (4.17)  we  see  that  we 
should  write* 


(4.65)  P(Ti  S  t)  =  P(tj  i  t  1  Y  SX)  +  P(TX  s:  i  &  X  <  Y) 

=  P(YfiXiiYi  t)  +P(X<Y!tHt) 


* 

Consider  7^  =  min  (X,Y). 
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where,  recall, 


Y  =  time  to  detect  decoy 


X  =  time  to  detect  an  HVT 


Now 


CO 

(4.66)  P(VSUYSt)  =  /  P(Y  S  T  &  Y  i  t)fx(T)dT 


■/ 


P(Y  S  T)f  (T)dT  +P(YSt)  |  f 

o  *4 


f 


Similarly 


P(X  <  Y  &  X  5  L) 


■/ 


r(x  s  t)fy(T)dr  +  p(x  £  t)  |  f 


/ 


We  now  examine  the  exponential  and  Erlangian  cases. 


4.4.1  Exponential  Case 


Recall  that  in  this  case 


f  (t)  =  Pe  p  ,  t  >  0  and  f  (t)  =  Xe  ,  t  >  0 

A  Y 


Thus,  using  (4.66)  we  have 


(4.67)  P(Y  i  XtYi  t) 


-f 

•'n 


(1  -  e"XT)Pe"0TdT  +  (1  -  e_Xt)e"Pt 


p  p  -(x+p)t  -a+p)t 

=  1  -  * - -  +  r - -  e  -  e 

X  +  P  X  +  0 


x(T)dT  . 


y(T)dT  • 
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Similarly 


(4.68)  P(X  <  Y  &  X  ^  t) 


X  X  -tt+P)t  -(X+P)t 

-  r - -  +  : - —  e  -  e 

X  +  g  X  +  p 


Hence  (4.65)  gives  us 

(4-69)  P(T1  S  t)  =  1  - 


or 


(4.70) 


f^t) 


(X  +  P)  e 


-(X+p)t 


4.4.2  Erlangian  Case 

Refer  to  the  Erlangian  part  of  Section  4.3.1.  Using  (4.21a) 
and  (4.22)  we  have 


(4.71)  P(Y  £  X  &  Y  £  t) 


=  J  [l  -  (2XT+l)e~2^T]4PSTe  '^d* 


+  [l  -  (2Xt+l)e'2U][2Pt+l]e"2Pt 


=  1  - 


B?+3pPxl  (V+3p2xl  r  ,-2<X+p) 

[o^r\ +  i(xTpjn [2(X+P)t  +  i]e 


4X02t2e 


-2(X+P)t 


X  +  0 


-  (2Xt+l)(2pt+l)e 


-2(X+0)t 


A  similar  expression  holds  for  P(X  sYfeXSt).  Add  these  expressions 
to  get 


(4.72) 


P(T 


St)  =  1  +  [2(X+P)t+1  -  2(2Xt+l)(20t+l)  +  8X0t2]e 


-2(X+p)t 


=  1  -  [2(X+0)t+l]e“2<X+P)t 


52 


53 


Similarly 
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whe  re 
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By  noting  that  -  m*(s)-*— » 
s 

integrating  F^(t) .  Thus 


F(T)dT  we  obtain  m*(s)  =  —  m*(s)  by 

^  S  1 


(4.82) 


/t  r  (a+ 

F  (T)dT  =  —  +  —  ~ - 

1  c  2p  L  a  + 


(a+p)t  (a-p)fl 
e  i 


P  a  -  p 


From  (4.78)  it  follows  that 


(4.83) 


i  .e. , 


H12(t)  =  ai2^+&>  O^t)  +  pF2(t)] 


(4.84)  H  (t) 
12 


where 


a12(X+P) 


tv  +a  a 
23  21  13 


(l  +  ^)e<a+P>t  -  (l  ♦  J^)e(°-p)t1 


C1  =  d  “  <X22>Vl  +  X  +  P 


C2  '  to23  +  0,21°'13)P<US) 


*  *  'V2 


p  =  % 


Typically  a  +  p  is  negative  and  very  close  to  zero,  so  the  right-hand 

a  aY2 

term  in  (4.84)  decays  to  zero  as  t  -*  »  and  K  „(t)  / -  as 

12  or  +  O'  a 

23  21  13 

t  -»  00 .  Note  H  (0)  =  0. 

1m 

By  a  similar  approach  H  (t)  could  also  be  found.  Then, 

MM 

given  p  and  p  ,  the  unconditional  expected  number  of  decoys  encountered 

1  M 


is  given  by  +  P2H22(t) 


4.5.2  Erlangian  (k=2)  Case 


Suppose,  as  in  (4.73),  that 

fx(t)  =  4(X+g)2t  e"2(UP)t 

and 

f  (t)  =  4ji2t  e~2|it  t  >  0 

w 

Then 


(4.85)  f*(s) 


2(X+g) 
2(X+g)  +  sJ 


and  f  *(s) 


since 


f  4a2 1  e'<2a+5>t 


-(2a+.s)t 

4a=  '  ho-rtf  C‘  <2a+S) 


Thus 


(4.86)  h*  (s) 

Vet 


r  2(x+p)  -| 
L2(X+P)+sJ 

2 

1  -  a 

22 

r_2ii_i 

L2h+sJ 

Of  a  i 
12  21  1 

[^]  1 

r  2(X+p)  -i2 
l2(X+p)+sJ 

a  _ [2(X+P)]S[2^s]g  _ _ 

12  [2(X+P)+s]2[2,i+s]2  -  o  C2^]2[2(X+9)+s7  -  c*  a  U|.i(X+P)]2 

““  61 


=  4«12(X+3)2 


P(s) 

q(s) 
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whe  re 


W 

I 

vv 


i 


p(s)  =  s2  +  4^iS  +  4ji2 

q(s)  =  s4  +  4(X+3+(.i)s3  +  4[  (X+P+ii)*'  +  2p(X+P)  -  a^p  3s 

+  16M(X+P)  U+3  +  (1  ~  <*22>p3s  "  ^•4|j(X+^^2(a22+af12a21) 


Moreover 


(4.87) 


“t2(s) 


4^12 (X+3) 


sp(s) 

q(s) 


Referring  to  the  Heaviside  expansion  theorem  (e.g.,  Ref.  6,  1021),  we 
can  write  1 


(4.88) 


V° 


v(v  v 


where  r  =  4  is  the  number  of  roots  of  q(s)  =  0  and  a  ,  k=l,  ...,  r  are 

K 

the  roots.  Reference  4  (p  66  ff)  discusses  methods  for  obtaining  roots 
of  polynomials  numerically;  such  methods  are  commonly  available  as 
computer  programs. 


4.6  Distribution  Function  of  First  Passage  Time 

First  passage  time,  T  ,  was  defined  in  general  in  Section  3.2. 

Expected  first  passage  times  for  the  search  model  were  considered  in 

Section  4.2.  In  this  section  we  derive  the  probability  distribution 

function  G  (t)  for  the  conditional  first  passage  (or  absorption)  time 
U 

T  in  the  case  of  exponential  f  (t).  The  algebra  here  is  quite 
13  i 

similar  to  that  of  the  preceding  section. 
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From  (3.12)  we  have  0^(0  =  POT^  <  t)  =  1-^(1)  .  Recalling  that 
in  the  terminology  of  Sections,  p^t)  2  r^Ct),  and  using  (4.11),  we 
have  that 
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Using  the  methods  of  Section  4.5  we  arrive  at 


(4.93) 


1  +  - 

2p 


(X+P)a  +  - 

13  a+p 


(a+p)t 


where 


Note 


(X+B)c<13 


+ 


(a-p)t 

e 


-  "V2 


=  h\L 


2  V  i 


4c. 


a  +  p  <  0 


a  -  p  <  0 

Hence  F(0)  =0  and  F(+  “)  =  1.  For  a  check  on  the  result  we  can  use 
the  fact 

/CD 

[l  -  Gi3(t)]dt  . 

A  simple  check  is  obtainable  in  the  case  n  =  1,  where  we  can  use 

d  +  ^ 

equations  (4.43)  with  (4.12)  to  obtain  E^T13lnd  =  D  =  ’ 

c 

the  same  result  is  obtained  using  (4.94). 

By  a  similar  approach,  G  (t)  could  also  be  found.  Then,  given 

p  and  p  ,  the  distribution  function  G  (t)  of  the  unconditional  time 
12  3 

is  given  by 

(4.95)  V‘>  *  Pl°13(t>  +  P2°23(t>  ,  ' 
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4.7  Initial  State  Probability  Vector 


The  concept  of  initial  state  probability  was  introduced  i.i 
Section  3.3.  In  the  present  section  we  discuss  a  simple  submodel  for 
computing  these  initial  probabilities  for  the  three-state  search  model 
under  consideration. 

Assume  that  the  searcher  enter  the  operating  area  A  in  a  blind 

o 

condition  (at  high  speed,  say)  and  remains  blind  until  both  the  HVT  and 

decoy  detection  circles  are  inside  A  .  Some  time  after  the  circles  are 

o 

inside  A  (immediately  perhaps),  the  search  process  begins  when  the 
o 

searcher  instantaneously  scans  his  search  field.  This  initial  scar 
results  in  an  event  which  places  the  searcher  in  one  of  the  three  states 
of  the  model 

1.  The  searcher  sees  no  targets,  and  starts  search 

2.  The  searcher  sees  at  least  one  decoy,  selects  a 
decoy  for  classification,  and  starts  classifying 

3.  The  searcher  sees  at  least  one  HVT,  selects  an  HVT 
for  classification,  and  starts  classifying. 

These  events  are  mutually  exclusive  and  exhaustive.  If  we  label  them 

with  i,  i  =  1,  2,  3,  then  i  occurs  with  probability  p  and  p  +  p  +  p 

jl  X  «5  o 

We  have 

p^  =  P{no  targets  present} 

(4.96)  p  =  P{at  least  one  decoy  present  and  pick  decoy} 

Ct 

p  =  Pfat  least  one  HVT  present  and  pick  HVT} 
o 

Determination  of  the  p^  is  very  similar  to  the  determination  of  the 

Ctf  in  Section  4.3.3.  The  reader  is  referred  there  for  details. 

2i 
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As  before 


P  =  ttr2  /A 

C  CO 


P  =  rtlr  /A 
d  do 


unless  we  are  using  the  reduced  overlap  submodel,  in  which  case  we  use 

P  (X  )  instead  of  P  ,  Then 
co  c 

n  nri 

(4.97)  p  =  (1-P  )  C(l-P  ) 

1  c  d 


P{k  decoys  present  and  pick  decoy} 


"d  n 


■££0W*« 


I  i  V*  k 
IP  (1-P  )  7-7 

c  c  £+k 


^  P[jt  HVTs  present  and  pick  HVT] 
1=0 


nd  ”, 


■££0W*0 


I  t  n  "A  , 
Ip  (1-P  )  C  — 
c  c  x+k 


Of  special  interest  is  n^  =  1,  in  which  the  above  expressions  reduce  to 


(4.98)  P,  =  (1-P  )(1-P  ) 

1  c  d 

’*  ‘  pc(1'pd>n<' + t1  -  (1-pd)Dd]  [pd(V»  -  Pc]/[VV1>] 
P3  *  “I1  ’  a-Pd)V  ]/[Pd(V1)]  • 


An  alternative  approach  is  to  assume  the  searcher  makes  his  initial 
scan  at  some  point  in  time  prior  to  entry  of  the  complete  detection  circles 
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ini.o  A  .  In  this  case  appropriate  area  ratios  other  than  P  and  P 
o  c  d 

would  be  used.  Note  that  the  forward  half  of  the  circumferences  of  the 

detection  circles  must  be  in  A  in  order  for  the  previously  discussed 

o 

detection  rates  to  be  valid. 


4.8  Summary  of  Three-State  Model 

A  summary  of  the  three-state  model  is  given  in  Fig.  4-3  in  the  form 
of  a  flow  graph.  For  purposes  of  this  flow  graph  the  area  approach  is 
used  for  calculating  transition  probabilities,  and  it  is  assumed  that, 
search  and  classification  times  are  exponentially  distributed. 


Assumptions  that  have  been  made,  explicitly  or  implicitly,  thus  far 

are 


•  At  any  fixed  instant  in  time,  positions  of  HVTs 
and  decoys  are  distributed  over  the  operating 

area  according  to  a  uniform  probability  distribution 

•  Over  short  intervals  of  time,  everythirg  moves  in 
straight  lines  with  uniformly  random  headings 

•  Definite  range  law  for  detection 

•  All  detection  circles  lie  inside  the  operating  area 
(i.e.,  the  searcher  as  well  as  the  HVT  knows  what 
the  operating  area  is;  see  Appendix  C  for  an  analysis 
of  one  place  where  this  assumption  may  fail) 

•  When  a  decoy  is  classified,  information  obtained  by 
the  searcher  is  dissipated  rapidly  enough  so  that 
the  classification  has  no  operational  effect  on  the 
density  of  decoys 

•  When  presented  with  an  array  of  targets  (both 
decoys  and  HVTs)  from  which  one  is  to  be  selected 
for  classification,  the  targets  are  equally  likely 
to  be  chosen  (i.e.,  the  decoys  are  identical  aid 
are  indistinguishable  from  the  identical  HVTs  until 
a  classification  is  made) 

•  Stochastic  independence  of  notion  is  assumed  among 
decoys  as  a  group,  among  HVTs  as  a  group,  and  between 
the  two  groups  except  in  the  case  of  reduced  overlap 
when  HVTs  avoid  decoys. 
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F>QUft£  4-3  LOGICAL  FLOW  OF  THREE - STATE  MOOEL  WITH  EXPONENTIAL  DISTRIBUTIONS  (Concluded) 


5 .  EXAMPLE  RESULTS 


Eight  cases  are  defined  for  the  purpose  of  numerical  illustration 
of  the  three-state  search  model.  The  area  approach  to  computing  tran¬ 
sition  probabilities  is  used  with  a  circular  area  of  200-nautical  mile 

radius.  A  single  HVT  is  assumed  throughout  (n  =  1)  ;  i.  decoy  classifi 

c 

cation  time  of  5  hours  is  used  in  all  cases  (E(T  )  =  =  5) . 

A 

The  cases  are  defined  in  Table  5-1.  In  cases  1-4  the  decoys 
operate  like  the  HVT,  while  in  cases  5-8  the  decoys  operate  in  a 
different  manner  than  the  HVT.  In  particular,  in  cases  7-8  the  decoys 
are  stationary.  With  one  exception,  to  be  discussed  later,  all  search 
times  are  taken  to  be  exponentially  distributed  as  in  (4.70). 


Table  5-1 


CASES  FOR  NUMERICAL  ILLUSTRATION 


Case 

M 

V 

(k?s) 

(kts) 

R 

(nmi) 

(nmi) 

■ 

5 

10 

H 

25 

HVT  and  decoy 

5 

80 

n 

10 

.  10 

o 

15 

15 

same 

10 

KjMjj 

20 

50 

50 

5 

wm 

IS 

-PI 

wm 

§9 

HVT  and  decoy 

6 

1 

10 

KLI 

H 

10 

n 

25 

80 

different 

10 

10 

■s 

15 

50 

Figure  5-1  displays  conditional  expected  time  (in  hours)  to  HVT 

detection  E(T  In J)  versus  number  of  decoys  n.  The  broken  versus 
13  d  d 

solid  line  distinguishes  searcher  speed  (broken-  V  =5  kts;  solid- 

t  S 

Vg  =  10  kts).  The  striking  feature  of  the  data  in  this  figure  is  the 
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Preceding  gage  Wan* 
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effect  of  nonsimilarity  between  decoy  and  HVT.  In  all  the  sharply 
rising  curves  the  decoys  are  different  in  detectability  and  speed  than 
the  HVT. 

Figure  5-2  illustrates  the  effect  on  E(T,  In  )  of  reduced  overlap 

13  d 

between  decoys  and  the  HVT.  Cases  4  and  7  are  considered.  A  notable 

feature  in  these  data  is  the  significant  interaction  between  X^  and 

case  considered.  Recall  that  Xq  is  the  maximum  acceptable  rate  of  HVT 

course  change  for  purpose  of  decoy  avoidance,  i.e.,  X  -1  is  the  mean 

o 

time  between  such  course  changes.  The  principal  expression  for  the 
queue  model  of  reduced  overlap  ia  given  by  (4.64). 

Figure  5-3  shows,  for  Cfilfw  8,  the  conditional  (on  starting  in 

state  1)  expected  number  of  diteoys  encountered  prior  to  HVT  detection 

Hi3(t|nd)  as  a  function  of  time  in  days  and  number  of  decoys  deployed. 

The  broken  line  is  k'(T^ln^)  units  of  days.  The  limiting  values  of 

**,«(*! *0  as  t  ->  «  are  shown  on  the  right. 

13  a 

Figure  5-4  shows,  for  Case  5,  the  conditional  cumulative  probability 

Gl3 (t | n^)  of  HVT  detection  versus  time  and  number  of  decoy^.  Recall  that 

G  (t|n.)  is  the  probability  the  HVT  is  detected  at  or  before  t  given 
13  u 

there  are  n.  decoys  deployed.  The  ourves  for  n  =  0  and  n  =  1  are 
d  d  d 

practically  coincident  and  are  represented  by  a  single  line.  Thus,  for 
example,  in  a  9-day  operation,  deployment  of  20  decoys  of  Case  5  type 
reduces  the  probability  of  HVT  detection  down  to  .2  from  the  .6  obtained 
with  no  decoys. 

Figure  5-5  is  the  exception  to  the  exponential  distribution 
mentioned  earlier.  In  this  figure  the  solid  lines  represent  search 
times  with  Erlang  distribution  as  given  by  (4.73);  the  broken  lines 
are  exponential  data  shown  earlier  in  Fig.  5-1  and  repeated  here  for 
comparison.  The  peculiar  shape  of  the  curves  resulting  from  the  Erlang 
distribution  is  probably  due  to  a  failure  of  the  random  motion/position 
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FIGURE  5-3  EXPECTED  NUMBER  OF  DECOYS  ENCOUNTERED  vs  TIME  (CASE  5) 
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FIGURE  5-4  CUMULATIVE  PROBABILITY  OF  HVT  DETECTION  vs  TIME  (CASE  5) 
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assumption  and  other  considerations  discussed  for  the  exponential 
distribution  in  Section  4.3.3  under  "Model  Restrictions  Due  to  Overlap." 
Other  data  not  included  here  indicate  the  Erlang  results  approach  the 
exponential  results  as  n^  becomes  very  large.  However,  for  small  numbers 
of  decoys  there  is  a  significant  difference  in  the  implications  of.  the 
two  distributions.  Specifically,  decoys  are  much  more  effective  with 
Erlang  detection  times  than  with  exponential  detection  times.  This  is 
especially  true  since  the  errors  in  the  Erlang  curves  presented  here  are 
most  likely  in  the  direction  of  decreased  effectiveness  of  the  decoys; 
the  exponential  curves  can  be  considered  relatively  free  of  error 


6.  A  FOUR -STATE  MODEL 


This  section  demonstrates  how  the  three-state  model  can  be 
extended  to  a  four-state  model  to  analyze  the  parcicular  search  proce¬ 
dure  of  "sprint -drift"  motion.  It  is  important  to  empnasize  that  this 
is  a  demonstration  and  not  a  final  model  in  any  sense.  In  particular, 
not  included  in  the  model  is  a  representation  of  the  capability  for  the 
searcher  to  look  behind  himself  as  he  changes  from  sprint  to  drift. 

Such  a  capability  is  analogous  to  the  Instantaneous  scan  discussed  in 
Section  4.7  with  respect  to, initial  state  probabilities,  except  that 
the  scan  is  now  periodic  instead  of  occurring  only  at  time  zero.  This 

•  i 

capability  could  be  incorporated  into  a  model  but  it  is  not  done  here 
because  of  lack  of  time. 

.  .  j 

i*  , 

In  using  the  "sprint-drift"  method,  the  searcher  alternates 

between  high  (V  )  and  low  (V  )  speed,  with  corresponding  detection 
S  JL  S6  ' 

ranges  RCl>  RC2,  Rdl,  R^,  and  encounter  rates  X^,  X^,  0^,  and  0^. 

Typically,  V  »  V  and  V  „  will  be  close  to  zero.  The  speed  *V_ 

'  ••  •  si  sz  s2 

is  maintained  for  a  time  t^  after  which  speed  is  changed,  unless  a 

detection  occurs  before  t  ,  in  which  case  classification  commences. 

?  *  *  "  i  , 

Let  the  events  be 

i 

1.  Start  search  (V  ,)  , 

si 

2.  Start  search  (V  ) 

s2  • 

1  3.  Start  decoy  classification 

*  > 

•  '4.  Start  HVT  classification 


As  before,  we  assume  state  4  to  be  absorbing.  The  transition  matrix 
is  then 


(6.1). 


A 


1 


c 

O' 

12 

a 

13 

a 

14 

a 

21 

0 

a- 

23 

O' 

24 

ct 

31 

0 

a 

33 

34 

0 

0 

0 

1 

Note  we  are  assuming  that  after  classifying  a  decoy,  if  no  other  targets 
are  immediately  visible,  the  searcher  makes  a  high  speed  sprint  away  from 
the  decoy.  Also,  we  allow  a  limited  detection  capability  at  sprint  speed 
The  f  matrix  is 


(6.2) 


6.1  The  Transition  Matrix 


Consider  first  a  ,  which  is  actually  i  (t  )  a  function  of  search 
lo  1«3  L 

(sprint)  time  t  .  Thus 


W 


As  before,  let 


Pr[ Contact  a  decoy  before  an  HVT  and  before  t^| 

started  search  at  speed  V  ,  at  time  zero} 

si 


X,  =  time  to  detect  an  HVT  at  V  , 

1  si 

Y,  =  time  to  detect  a  decoy  at  V 


Then 


ai3(V  =  P[Y1  5  \  and  \  *  tx} 

=  p(y1  <  xi|yi  *  ti}P{vi  s  tj3 

-  p{yx  *  tx]  /  p{Yi  s  t|Yl  S  tl3fXi(t>dt 


Writing 


FXl(t) 


-  f 

•'a 


fXl(T)dT  and  Pv,(t) 


■/* 


Yl'k/  “  J  *y.(*OdT 
O 


“  Pi  X1  J£  t} 


=  p[yi  ^  t} 


we  have 


PfYj  £  tlTj  £  tj} 


(Fvi(t> 

fW 

l 


if  t  s  t 


if  t  >  t 


so  that 


t 

*13  (V  *  J  +  FY1(V[A  "  pXl(t1>J 


Analogously, 


/  1 


“l4(tl}  *  j  *Xi(t)fYi(t)dt  +  1  -  VV 


7? 


and 


6.2  The  f*  Matrix  and  Expected  Values 


In  this  model  we  don't  have  a  "p.d.f"  matrix  because  and 
(the  length  of  time  in  states  1  and  2,  respectively)  are  not  continuous 
random  variables.  Rather  they  are  mixed  random  variables  with  a  contin¬ 
uous  and  a  discrete  component  each.  This  is  all  right,  though,  because 
all  we  need  is  the  f*  matrix  (which  still  exists)  and  expected  values 
of  the  T  .  As  in  the  three-state  model,  the  forms  of  f  and  f  are 

1  *3  Hl 

arbitrary,  while  the  forms  of  f  and  f  must  remain  consistent  with 

1  2 

tne  “ij'8* 

We  proceed  now  to  examine  the  probability  distribution  of  t  .  The 
analysis  for  T  is  identical. 
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We  have 


PC*  £  t)  = 


if  t  is  t 


(P(Y!  *  Xi  k  Y1  *  t)  +  P(X1  *YlkX1*t)  if  0  <  t  <  t 


J1 


t  S  t 


Ka(t)  +  ai4(t)  0  <  *  <  \ 


Hence,  in  general,  P(T^  z  t)  is  discontinuous  at  t  =  t  .  We  have* 


P(T1  =  t)  = 


.0  t  t  tl 

1  -  «13(t>  -  or14(t)  =  or12(t)  if  t  =  ti 


fl(t|°  <  1  <  ti)  =  +  a’14(t)  =  a'12(t)  for  o  <  t  <  t 


Thus 


E(T 


=  *i  '  W +  /  1  *«i2(t)dt  • 


In  the  case  where  fXi<t)  and  fx„(t)  are  exponential  we  have 


V 


E(T  j)  =  t 


"(S+Pi)t!  n  -(ye, 

2e  +  /  tOyP^e  1  1 


)t 


dt 


-a  >*  -<yp  >t 

=  V  1  1  -  tie  1  1  1  -  S. 


■<X+P  >t 


x  +  p 


1  -  e 


■W'l 


vs 

An  analogous  equation  holds  for  Ely .  These  terms  are  required  In  the 

following  subsection  for  computing  E(T  ) . 

_  14  * 

* 

Where  the  prime  indicates  derivative  with  respect  to  t. 
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6 . 3  Conditional  Expected  First  Passage  Time 

Referring  to  (3.2),  (3.11),  and  (3.16)  we  proceed  to  derive 
E(Ti4).  Dropping  the  s  arguments  of  the  f*(s)  for  sake  of  clarity,  we 
have 


So 


g*(s) 


I  -  g*<s) 


0 

a  f* 

12  1 

a  f  * 
13  1 

a  f* 
14  1 

a  f  * 
21  2 

0 

a  f* 
23  2 

a  f  * 
24  2 

a  f  * 
31  3 

0 

a  f* 
33  3 

a  f* 
34  3 

0 

0 

0 

*: 

1 

•  V 

;  -• 

*  ♦ 

13  1 

a  f* 

PA  2 

1 

-  a  i* 
23  2 

-  of* 
24  2 

a  t* 

31  3 

0 

l  -  a  t* 
33  3 

- 

34  3 

0 

0 

0 

1  -  f* 
4 
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Thus 


g12 

g13 

gl4' 

Ci  - 

e\s)ri  A 

*21 

g22 

B23 

g24 

*31 

g32 

g33 

g34 

0 

L 

0 

0 

*44 

*“2C3d4 

Vfl2VV 

■a2(b3C4-b4C3)+(a3C4'a4C3) 

iV 

VWi* 

“WW 

(b3C4 

'b4C3 

l)"bl(a3C4'a4C3)+Cl(a3b4_a4b3 

d  n  c 

4  2  1 

V^V 

-c 

l<a2b4‘a4)“C4a-a2bl) 

0 

0 

c 

iSVV+V^V 

where  k  *  C1 W  "*  )  +  c  ^  ^-l1  b  ) 
Now 


.p*4(s)  =  Ci+b*]1#  •  w(4<.)  *  (i-f*)[I+h*]i4 

5  g  g  +Q[  O  "i 

4  ll  12*24  13*34  14*44j 


where 


24 


*34 


*44 


*  ‘  «24*2*  +  (a23a34-a24“33)f2f3*  +  Vl«fM 

+  (“21^3a34“a3iari3Q'24+a31Q'l4a23-^l“i4a33)rtf2f2 

k  ’  a34f3  +  “mVI's  +  (ai2a24a3raz2°2Ia34)fJf2f3 
1  * 

r  - 1  -  v.  •  wft  -  wft 
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and 


1  =  -•3i'5<wrf«i2«n'?2,«iJ,d*<w?<1-,,*rt>tl-,,iAi‘?i> 


So 


•PM(a) 


a  f*  +  a  a  t*t*  +  (a  a  -a  a  )t*t*  +  a  (a  a  -a  a  )f*f*f* 
14  1  12  24  1  2  ^13  34  14  33  1  3  12v  23  34  24  33  1  2  3 

1  "  ct„„f *  -  a,a„{V  -  a,„a0,f*f*  +  a,„(a„,a0 '-a„„a"  ,)f*X*f* 

3."  3  13  31  1  3  12  21  1  2  12  21  33  23  31  1  2  3 


u(a) 

v(s) 


mH>  . 


■4M-  ■ 


u(»)v'  (s)  -  v(s)u'  («) 
Vs  (e) 


s»0 


But  we  find  that  u(0)  =  v(0)  sines 


a  +  a  ar  +  ar  or  -  cr  o  +  a  (ff  o  -iy  a  ) 

14  12  24  13  34  14  33  12  23  34  24  33 

=  1  -  a  -  a  a  -or  a  +  a  (a  a  -a  a  ) 

33  13  31  12  21  12  21  33  23  31 

where 


°12  +  “IS  +  <14  =  «21  +  *23  +  <*24  *  <*31  +  *33  +  “34  =  l* 


Hence 


E(V 


v'(0)  -  u'(0) 
v(0) 


=  (l-a12)(l-a33)E(Ti)  +  «12(a21+a24)[E(Tl)  -  K(t2>] 

+  [C‘33l>aU)  +  °,13(a31+0,34>]E(T3) 

+  <*12  [a23(tt31+tt34)  “  g33(«21+V]  D(V  +  E(T2)  +  E(V] 
1  -  “33  ‘  *13*31  -  ai2a21  +  *l2<a21<,f33-«a3fl,31> 


where  E(t  )  =  -  —  f*(») 

i  ds  1 


s=0 


Note  that  if  we  set  or  =  0,  or  =  1,  E(t  )  a  0  and  make  the  proper 
1*  21  2 

Identifications,  we  get  (4.12). 
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7.  CONCLUSIONS  AND  RECOMMENDATIONS 


This  study  has  shown  that  the  semi-Markov  process  is  an  effective 
framework  within  which  co  study  questions  regarding  the  effectiveness 
of  decoys  in  delaying  a  searcher  looking  for  a  particular  type  of  tar¬ 
get.  In  particular,  the  four  questions  raised  in  the  Introduction  have 
been  answered  in  detail  for  a  constant  speed  searcher  and  constant  speed 
targets.  However,  output  expressions  H  (t)  and  G  (t),  respeccively 

CtCt 

the  number  of  decoys  encountered  and  the  cumulative  distribution  of  first 
passage  time  for  a  searcher  starting  in  the  classify  decoy  state,  remain 
to  be  derived.  Ihe  question  of  mean  time  has  been  answered  to  a  degree 
for  a  variable  speed  searcher.  Applications  to  other  search  and  related 
problems  are  implicit  in  the  type  of  analysis  that  has  been  conducted. 

For  example,  optimization  of  the  "sprint-drift"  search  tactic  is  a 
latent  application  of  the  four-state  model  discussed.  A  slightly  up¬ 
graded  four-state  model  could  provide  much  insight  into  "sprint-drift." 

Given  the  assumption  of  a  constant  range  detection  law,  the  three- 
state  model  is  a  suitable  representation  of  the  search  problem,  within 
the  limits  of  the  random  motion/position  assumption,  the  restrictions 
due  to  overlap,  and  a  large  (relative  to  detection  radii)  operating  area. 

In  order  to  extend  these  limits  it  is  recommended  that  the  effects  of 
geometry  and  time  on  the  state  transition  mechanism  in  the  three-state 
model  be  studied  in  detail  and  the  three-state  model  be  expanded  to  four 
states  by  including  a  secondary  search  state  as  discussed  in  Section  4.3.3. 
The  geometry /time  study  would  likely  include  numerical  calculations  to 
provide  functional  relations  for  generalized  use  within  the  context  of 
the  three-state  model  and  extensions.  Such  a  study  is  necessary  if  the 
model  is  to  be  used  for  optimization  (where  it  is  likely  to  be  pushed  to 
extremes)  or  for  study  of  relatively  large  decoys  (where  decoy  coverage 
approaches  the  size  of  the  operating  area) . 
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Several  interesting  questions  involving  constrained  optimization 
arise.  Loosely  rpeaking,  it  is  clear  that  the  more  decoys  that  are 
available  the  better  for  the  HVT.  However,  it  is  also  clear  that  the 
choice  of  decoy  configuration  and  number  of  decoys  is  a  constrained 
problem.  This  constrained  choice  problem  will  assume  characteristics 
dependent  on  the  circumstance  within  which  it  arises.  Some  possibilities 
are 

I 

1.  Given  specified  limited  funds  how  many  decoys  of 
what  configuration  should  be  built  to  optimize 
some  operational  variable,  such  as  probability 
of  HVT  detection? 

2.  Funds  are  "limited"  but  not  specified.  Therefore, 
it  is  desired  to  meet  some  operational  performance 
threshold  (such  as  a  minimum  acceptable  HVT 
detection  probability)  with  minimum  cost.  How 
many  decoys  of  what  configuration  should  be  built 
and  what  is  the  cost? 

A  third  question,  of  some  interest  in  initial  planning  stages,  is  how 
the  optimum  number  and  configuration  in  (1)  above  vary  as  the  amount  of 
available  funds  varies.  For  example,  it  may  be  of  considerable  interest 
to  know  whether  or  not  only  the  number  and  not  the  configuration  varies 
with  a  change  in  the  budget  constraint.  Of  course,  examination  of  any 
of  these  questions  requires  development  of  the  relation  between  per  unit 
decoy  cost  and  decoy  detection  range,  speed,  and  holding  (classification) 
time.  In  optimization  studies  such  as  suggested  here,  scenario  depen¬ 
dencies  (such  as  size  of  operating  area  and  operation  duration)  can  be 
removed  to  some  extent  by  considering  various  scenarios  and  applying 
probabilistic  weighting  factors  at  the  appropriate  places  in  the  analysis. 

Another  area  for  analytic  extension  is  the  situation  of  stationary 
decoys  where  the  searcher  can  plot  the  position  of  classified  decoys 
and  thus  render  them  relatively  ineffective.  The  three-state  model  is 
not  applicable  in  this  situation  because  the  transition  probabilities 
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change  with  each  decoy  that  is  classified.  What  is  needed  is  a  general 
n-state  formulation.  Such  a  formulation  may  be  obtainable  by  exploiting 
and  generalizing  the  special  structure  of  the  following  six-state  tran¬ 
sition  matrix  (where  the  stars  denote  allowable  transitions  and  the  state 
definitions  follow) 


where 

state  1  =  search  with  2  decoys  unclassified 
state  3  =  search  with  1  decoy  unclassified 
state  5  =  search  with  0  decoys  unclassified 
state  2  =  classify  decoy  with  2  decoys  unclassified 
state  4  =  classify  decoy  with  1  decoy  unclassified 
state  6  =  classify  HVT. 

Results  analogous  to  those  for  birth-death  processes  might  be  obtainable. 

A  ubiquitous  assumption  in  this  study  is  the  definite  range 
detection  law.  The  realized  detection  range  in  any  real  encounter  is  a 
random  variable  that  is  represented  in  the  models  discussed  here  by  a 
fixed  range  R  (which  depends  on  the  type  of  target  and  its  speed  as  well 
as  searcher  and  environmental  characteristics) .  If  the  target  comes 
within  R  of  the  searcher,  the  target  is  assumed  detected;  no  detections 
occur  at  ranges  greater  than  R.  The  value  assigned  to  R  is  usually  the 


85 


median  value  of  a  distribution  generated  by  models  outside  the  scope  of 
this  study.  The  search  models  presented  in  this  document  permit  sensi¬ 
tivity  studies  on  R  but  they  do  not  take  into  account  the  inherent 
variability  in  realized  detection  ranges.  Hence,  it  is  recommended  that 
a  study  be  conducted  to  determine  the  effect  of  this  inherent  variability 
on  the  results  produced  by  the  current  search  models.  Such  a  study  could 
be  conducted  with  Markov  process  models  and  could  examine  fade  zone 
effects  as  well  as  variable  detection  range. 

Recommendations  for  future  work  may  be  summarized  as  follows; 

•  Derive  output  expressions  for  a  searcher  starting 
in  the  classify  decoy  state 

•  Incorporate  geometry /time  interactions  into 
the  transition  mechanism  of  the  three-state 
model 

•  Expand  the  three-state  model  to  four  states  by 
including  a  secondary  search  state 

•  Optimize  decoy  configuration  using  the  three- 
state  model  to  gain  insight  into  dependency  of 
optimum  configuration  on  budget  constraints 

•  Incorporate  a  "clearing-turn"  maneuver  into 

the  four-state  model  and  subsequent  optimization 
study  of  "sprint-drift"  (e.g.,  find  the  optimum 
durations  for  sprinting  and  drifting) 

•  Develop  a  model  to  examine  the  situation 
where  decoy  classification  information  obtained 
by  the  searcher  does  not  dissipate  with  time 

•  Study  the  effects  of  detection  range  variation 
and  fade  zone  phenomena. 
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Appendix  A:  ALTERNATE  COMPUTATION  OF  Cl^  AND 

In  Section  4.3.3  we  determined  a  and  a  on  the  basis  cf  a 

Ct  tit 

specified  number  of  targets  and  finite  specified  area.  We  now  drop  ex¬ 
plicit  consideration  of  area  and  number  and  develop  an  approach  based 
on  target  density.  Equations  (4.27)  and  (4.28)  still  hold,  but  we  re¬ 
place  the  binomial  distribution  by  the  Poisson  distribution.  That  is, 

element  cf  area  AA  *♦  0  we  have 

decoys  in  AA)  -  1  -  XM  +  o(AA) 

decoy  in  AA)  =  X.AA  +  o(AA) 

HVTs  in  AA)  =  1  -  &AA  +  o(AA) 

decoy  in  AA)  =  @AA  +  o(AA) 

on  the  Poisson  process.  We  further  assume  that  the 
HVTs)  in  nonoverlapping  areas  are  mutually  indepen¬ 
dent.  Let  K  =  number  of  decoys  present  and  L  =  number  of  HVTs  present. 
Then 

(A. 2)  P(jJ  HVTs  present)  - 

where  x  =  6  ttr2 
c  c 

(A. 3)  P(k  new  decoys  present)  = 


where  y  =  6 /R* 


-x  x 


P(L  •=  jfc)  =  e  ~  i  =  0,  1,  ... 


P(k+1  total  decoys  present} at  least 
one  decoy  present) 

P(K  =  k+1 |k  ^  1) 


P(K  =  k+1  St  K  2  1) 
P(K  2  1) 


k  =  0.  1.  . 


P(K  =  k+1) /P(K  21)  k  =  0,  1,  . , 

k  =  0,  1,  . 


-y  k+1 

_ l _ 


1  -  e 


-y  (k+1)*. 


we  assume  that  8s  sn 


(A.  1) 


Pr(0 

Pr(l 

Pr(0 

Pr(l 


Consult  Refs.  1  or  2 
number  of  decoys  (or 
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Preceding  page  blank 


It  is  clear  that 


(A. 4) 


and  that 


a. 


21 


P{K  =  i|k  a  1)  •  P(L  =  0) 


x- 
_ : 

1  -  e 


(A.  5) 


a 


23 


P(K  =  k+1 1 K  a  1)P(L  =  i) 


J l 

1+ k 


Also 


-x-y 


00 


Oj 


1  -  e 


-y 


* 


i  X 

jfc+k  l\ 


k=0  |=1 


k+1 

JL _ 

(k+1)  I 


(A.  6) 


a. 


22 


00 

Uk  P(K  =  k+1lK  58  1)pa  = 

k=l  tTo  * 


-x-y 

e 


k=l  1=0 


,  l  k+1 
k  x  y  - 

4+k  t\  (k+1)’. 


It  happens  that  (A. 6)  is  the  more  complicated  expression  and  is  best 
obtained  as  a  =  i  -  a  ~  a  .  So  we  examine  (A. 5).  Let 

a!  Cid 


(A.  7) 


m 


e 


-x-y 


1 


-y 

e 


and 


P 


x 

y 
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'  mjS/QcssJutsisiti^tiJt a£*i&ai£Zi& 


Then  we  can  write 


(A.  8) 


a 


23 


=  m  x 


oc 

E 

k=0  |=1 


00 

V-L 


J&-1  k+1 

x  _iL 


i  jt+k  U-l)!  (k+1)'. 


=  m 


00 

■E 

k=0 


k+1 

JL _ 

(k+1) 


=  «■*/;  [<’<1+P>J'  -  epy]  d. 
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We  have  thus  replaced  a  double  sum  by  a  single  sum,  but  the 


summation  operation  is  still  infinite. 
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Appendix  B:  ALTERNATE  REDUCED  OVERLAP  MODELS 


In  Section  4.3.3  under  the  heading  "Reduced  Overlap"  we  considered 
a  queuing  model  of  HVT/decoy  interaction  due  to  overlap.  This  appendix 
presents  an  alternative  class  of  models  for  representing  the  interaction. 
This  alternative  class  requires  specialized  data  and  has  no  special  de¬ 
cision  variable  for  controlling  overlap  per  se.  The  queuing  model  is 
therefore  viewed  as  a  more  fruitful  approach  and  the  alternative  class 
is  presented  basically  for  completeness. 

We  first  consider  P  simply  as  a  function  of  number  of  decoys  or 
c 

decoy  density*  Define 

(B.l)  P  =  ttR2/A 

CO  CO 

and  redefine  P  a  function  P  (n .)  or  P  (6.)  as  P  multiplied  by 
c  c  d  c  d  co 

weighting  factor.  For  example,  we  could  write 

(B  .2)  P  (n  )  =  P  [l  -  e  d] 

c  d  co  ^  J 

If  we  could  establish,  for  example,  that  P  (10)  =  “  P  ,  then  we  would 

c  2  co 

have  a  =  0.069315.  This  function  is  depicted  in  Fig.  B-l . 

More  generally,  we  can  consider  the  contact  rate  X  as  defined  in 

c 

Section  4.3.3.  We  could  then  write 

(B.3)  P  (X  )  =  P  [l  -  e  SXc] 

c  c  co1-  J 


or  alternatively 


f  -2aX 

(B.4)  P  (X  )  =  P  Ll  -  (2aX  +  1)  e  C 

c  c  co  c 
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preceding  page 


FIGURE  B-1  Pc  AS  A  FUNCTION  OF  NUMBER  OF  DECOYS 


Using  (B.4) , 
Fig.  B-2 . 


suppose  we  knew  P  (1)  =  —  P 

c  2  co 


Then  a  =  0.85  and  we  have 


96 


Extending  this  approach,  suppose  it  could  be  determined  that  the 
situation  looks  like  Fig.  B-3.  That  is,  things  can  be  kept  pretty  well 


FIGURE  B-3  EXTENSION  OF  Pc  AS  A  FUNCTION 
OF  ENCOUNTER  RATE 


under  control  until  the  encounter  rate  X  reaches  some  critical  level, 

c 

after  which  the  ability  to  separate  deteriorates  rapidly.  Such  a  curve 
can  be  obtained  by  fitting  data  to  the  equation 

X 

x  _  a  k  CC  k_1  “kauj 

(B.5)  P  (X  )  =  P  ■=r~-r  /  u  e  du 

c  c  co  r(k)  J 

•'o 

In  the  absence  of  data,  (B.b)  could  be  established  by  specifying  two 

points  on  the  curve  such  as  (X ,,P  (X  ))  and  (X  ,P  (XI)  shown  in  Fig.  B-3. 

1  c  1  2  c  2 
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Appendix  C:  OVERLAP  MODEL  ERROR  STUDY 


In  the  discussion  of  the  reduced  overlap  model  in  Section  4.3.3  it 

was  recognized  that  the  assumption  A* /A  =  (R  /R  )2  could  fail.  Indeed 

s  c  s 

it  will  fail  if  the  decoy  being  classified  is  within  R  +  p  of  the 

c  d 

perimeter  of  the  operating  area.  In  order  to  get  a  rough  assessment  of 

the  error  introduced  by  this  failure  we  examine  a  particular  case  with 

R  =70  nmi  and  P  =  25  nmi.  Let  "r"  denote  the  event  "decoy  being 
c  d 

classified  is  located  r  nmi  from  the  center  of  the  operating  area." 

Assume  r  is  uniformly  distributed  between  0  and  Rq,  the  radius  of  the 

operating  area.  Assuming  that  "r"  is  independent  of  "HeA  "  we  can  write 

s 

(C.l)  P(HeA*[H€A  )  =  £  P(HeA*|HeA  &  r)P(r) 

8  r  s 

where  we  are  implicitly  quantizing  r  and  P(r)  is  the  probability  of  a 
specific  value  of  r.  Actually,  we  consider  11  equally  likely  values  of  r, 

r  =  20i  i  =  0,  10 

P(rt)  =  1/11  . 

Hence, 

10 

(C .2)  P(H€«*jHeA  )  =  (1/11)  £  P(HeA*|HcA  &r). 

S  i=0  »  i 

P(HeA*|HeA  &  r. )  Is  further  decomposed  by  conditioning  on  the  location 
s  1 

of  the  searcher  on  the  perimeter  of  the  classification  circle  of  radius 
about  the  decoy.  We  assume  the  searcher  is  uniformly  distributed 
along  that  portion  of  the  classification  perimeter  that  is  located  InBicle 
the  operating  area.  This  assumption  is  questionable  for  those  values  of 
r  where  the  classification  perimeter  is  entirely  inside  the  operating 
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area  but  is  close  to  the  perimeter  of  the  operating  area;  for  now  we 

«  * 

Ignore  this  possible  source  of  error.  This'  searcher  distribution  is  also 
quantized  into  discrete  points  (6  to  10  points  depending  on  the  value  of 
r  and  the  resulting  geometry) .  We  then  have 

nr 

(C.3)  P(HfiA*|HeA  8c  r  )  ='  (1/n  )  53  P (HeA* | HeA* | HeA  8c  r  &  s.) 

'si  r  s  i  j 

where  ”s  "  denotes  searcher  is  in  position  j  and  n  is  the  number  of 
j  r 

searcher  positions  for  distance  r. 

The  area  P(HeA*|HeA  8s  r  8c  s .)  can  now  be  measured.  A  planimeter 

s  j  j 

was  used  for  the  small  study  but  the  procedure  could  easily  be  programmed 

for  a  digital  computer.  The  situation  is  depicted  in  Fig.  C-l  for  a 

given  value  of  r  and  s  .  The  ratio  of  the  shaded  area  to  the  crosshatched 

J 

area  is  the  probability  to  be  measured.  The  reader  can  compare  Fig.  C-l 

with  Fig.  4-2.  The  results  obtained  for  P(HeA*|HeA  8c  r  )  are  shown  in 

S  1 

Fig.  C-2  with  a  smooth  curve  fitted  to  the  data. 

P(H6A*|h«As)  is  then  calculated  to  be  0.583  via  the  formula  (C.3). 
This  is  to  be  compared  with  the  approximation  (R  /R  )3  =  0.544.  Thus, 

C  8 

the  error  appears  to  be  small.  An  appropriate  modification  of  the  reduced 

overlap  model  including  the  calculated  value  0.583  was  exercised  and  the 

resulting  change  from  using  (R  /R  )2  in  the  operational  measures  E(T  ), 

c  s  13 

H  (t),  and  G  (t)  was  found  to  be  negligible  in  the  caee  examined 
13  13 

(R  =  70,  pJ  =  25,  R  =  200) . 
c  d  o 

Thus,  although  it  is  by  no  means  a  definitive  error  study,  this 

set  of  calculations  indicates  P(HcA*|hca  )  =  A*/A  is  a  reasonable 

s  s 

approximation.  The  approximation,  can  be  expected  to  break  down  as 

R  +  PJ  approaches  or  exceeds  R  . 
c  d  o 
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RATING  AREA 


FIGURE  C-1  GEOMETRY  FOR  MEASURING  P(H£A*|H€A 


Appendix  D:  A  MINIMAL  MARKOV  PROCESS  FORMULATION 

As  mentioned  in  Section  3  the  special  case  where  f  (t)  =  f  (t)  is 

*  J  A 

an  exponential  distribution  is  a  Markov  process.  Markov  processes  are 
discussed  extensively  in  Refs.  1  and  2  where  they  are  given  another  char¬ 
acterization,  that  of  the  minimal  process,  which  arises  from  particular 
assumptions.  The  concept  of  minimal  process,  with  its  "infinitesimal 
generator  matrix,"  and  its  relation  to  our  present  characterization  of 
the  SMP  is  discussed  by  Karlin  (Ref.  2,  Chs.  7  and  8).  A  brief  discussion 
is  included  here  for  completeness.  The  more  classical  minimal  process 
approach  was  not  used  in  the  main  body  of  the  study  because  the  alterna¬ 
tive  was  more  suited  to  the  events  occurring  in  the  real  phenomena  under 
consideration. 

We  assume  a  stationary  continuous  (in  t)  transition  probability 
matrix  P(t)  =  [p  ( t) J  defined  by  p  (t)  =  Prfx(t+s)  =  j|x(s)  =  i]  where, 

^  J 

using  our  previous  terminology  from  Section  3 

Pr{X(t+s)  =  j|x(s)  =  i}  =  Pr{A  <t+s) |A  (s)} 

J 

with  A  (t+s)  =  fioefhx  (t+s)  =  j} 

j  u> 

Cl^A  (s)  =  {u>efi:x  (s)  =  i] 

i  <ju 

The  relationship  to  our  SMP  terminology  is  given  by 
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and 


j'lA 

(o 


i  t  j 

i  =  J 


i  >  J=1 >  » •  •  t 


The  question  can  be  raised  as  to  how  to  formulate  our  search 
problem  so  as  to  have  a  minimal  Markov  process.  Let  us  assume  that 
for  small  At 


where 


p  (At)  =  \ -At  +  o(At) 

pig(At)  *  P'Ac  +  o(At.) 

p21(At)  =  [p  -  At  +  o(At)]ori 

p„.(At)  =  [p'At  +  o(At)]a 

P-.CAt)  =  poo(At)  =  0  for  all  At 

o  I  o« 


=  P{no  new  targets  in  view  when  finished  classifying  decoy) 

a  -•  pfat  least  one  HVT  in  view  and  chosen  from  field  of 
3 

targets  when  finished  classifying  decoy). 


Note  01  is  given  by  (4.31),  or  (-1.32)  if  n  =  1,  or  (A. 5).  We  have 

3  nc  nd_1  C 

a  given  bv  a  =  (1-P  )  (1-P  )  where  P  and  P,  art,  as  before;  or 

11  c  d  c  d 

can  be  given  by  (A.*./. 


10S 


We  require 


(i) 

E  pij(t)  =  1 
j«i 

all  t^O,  all  1=1, 

,  N 

(ii) 

p  (t)  2  0 
^  J 

all  t  ^  0,  all  i,  j=l, 

(iii) 

P(t+s)  =  P(t)P(s) 

(iv) 

U».  P  ft)  =  {J 

<■  -4  n  ^  J 

i=j 

,  N 


From  the  continuity  properties  of  P(t)  it  can  be  shown  th8t  p'^O) 
exists  for  all  i  and  j. 

We  define  the  state  transition  rate  matrix  (or  infinitesimal 


generator  matrix)  Q  =  (q^j)  0s  follows 


< « 


all  ij*J 


q  =  p'  (0)  =  lim 

il  ii  h 

J  J  h  -♦  0 

1  -  P  .(h) 

q  .  =  “  q,  where  q.  —  “  P*(0)  =  lim  - Z - 

11  1  1  h  -»  0 

In  our  case  of  a  finite  state  space,  q^  <  08  all  i,  j  and  q^  =  0. 

Q  is  nonpositive  on  the  main  diagonal,  non -negative  off  the  main 

Qt 

diagonal,  and  its  row  sums  are  zero.  It  can  be  shown  that  P(t)  =  e 
(matrix  exponential).  Then  by  definition  we  have 


q  =  X  i  q 
412  '  413 


“21  -  V’  "22  =  V 


q31  °  ”  q32 


and  since  the  row  sums  are  zero,  we  complete  with 


qn  =  -  (X+P),  q22  =  -  (c WM,  q33  =  °- 
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Thus 


(X+P) 


Q'1U 


-  a3p 

o  0 


Using  the  method  of  Cox  and  Miller  (Ref.  1,  p  196  ff)  we  obtain 


E(T  )  = 


^l+a3^M  +  X 


13  [P(a1+Q'3>  +  a3X][i 

This  is  identical  with  (4.12)  when  the  following  identifications  are  made 


Q?1  •* — ► 

tt21  ’ 

«3  "• 

-*•  a 

23 

ai3 

X 

a 

14 

_>  J_ 

x+p  ’ 

X+P 

E(T  ) 

1 

x+p  ’ 

B(T2)  - 

I 

li 

If  we  use  the  area  approach  in  computing  a  and  a  and  if  we 

1  3 

consider  the  special  case  n  =  1„  we  can. use  (4.32)  to  compute  a  and 
nd-l  c  3 

OL  =  (1-P  H1-PJ  ,  so  that 
x  r  a 

«  ..  pd"d  -  »-y['-a-y'’"  *3  +  ply„  +  a-*/11  -  il 

1  3  ’  vT~ - 


and 


*(ti3IV1)  = 


+  Ydx 


d  ]  *  pXyd+.«-y"d-0|d 

IJ  “*1  "T1 1,11 

iVd+<i-*.{i-«-p. .» d  3 +  pIVd+<i-pd,”d-i]|f  *  pc[i-<’-p/d}V 


11  o 


On  the  other  hand,  consider  the  case  of  no  overlap,  so  that 


o?l  =  1 1  0*3  =  ° .  Then 


i<tiA-«  -|*r-  ■ 

So  once  all  the  variables  determining  X  and  3  are  fixed  E(T  la  =  1)  !<= 

'  13  1  / 

a  linear  increasing  function  of  *,  the  mean  classification  time. 
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